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Preface 


Preface to the First Edition A study of this book, and espe¬ 
cially the exercises, should give the reader a thorough understanding 
of a few basic concepts in analysis such as continuity, convergence 
of sequences and series of numbers, and convergence of sequences 
and series of functions. An ability to read and write proofs will 
be stressed. A precise knowledge of definitions is essential. The be¬ 
ginner should memorize them; such memorization will help lead to 
understanding. 

Chapter 1 sets the scene and, except for the completeness axiom, 
should be more or less familiar. Accordingly, readers and instructors 
are urged to move quickly through this chapter and refer back to it 
when necessary. The most critical sections in the book are §§7-12 in 
Chap. 2. If these sections are thoroughly digested and understood, 
the remainder of the book should be smooth sailing. 

The first four chapters form a unit for a short course on analysis. 
I cover these four chapters (except for the enrichment sections and 
§20) in about 38 class periods; this includes time for quizzes and 
examinations. For such a short course, my philosophy is that the 
students are relatively comfortable with derivatives and integrals but 
do not really understand sequences and series, much less sequences 
and series of functions, so Chaps. 1-4 focus on these topics. On two 
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or three occasions, I draw on the Fundamental Theorem of Calculus 
or the Mean Value Theorem, which appears later in the book, but of 
course these important theorems are at least discussed in a standard 
calculus class. 

In the early sections, especially in Chap. 2, the proofs are very 
detailed with careful references for even the most elementary facts. 
Most sophisticated readers find excessive details and references a 
hindrance (they break the flow of the proof and tend to obscure the 
main ideas) and would prefer to check the items mentally as they 
proceed. Accordingly, in later chapters, the proofs will be somewhat 
less detailed, and references for the simplest facts will often be omit¬ 
ted. This should help prepare the reader for more advanced books 
which frequently give very brief arguments. 

Mastery of the basic concepts in this book should make the 
analysis in such areas as complex variables, differential equations, 
numerical analysis, and statistics more meaningful. The book can 
also serve as a foundation for an in-depth study of real analysis 
given in books such as [4,33,34,53,62,65] listed in the bibliography. 

Readers planning to teach calculus will also benefit from a careful 
study of analysis. Even after studying this book (or writing it), it will 
not be easy to handle questions such as “What is a number?” but 
at least this book should help give a clearer picture of the subtleties 
to which such questions lead. 

The enrichment sections contain discussions of some topics that I 
think are important or interesting. Sometimes the topic is dealt with 
lightly, and suggestions for further reading are given. Though these 
sections are not particularly designed for classroom use, I hope that 
some readers will use them to broaden their horizons and see how 
this material fits in the general scheme of things. 

I have benefitted from numerous helpful suggestions from my col¬ 
leagues Robert Freeman, William Kantor, Richard Koch, and John 
Leahy and from Timothy Hall, Gimli Khazad, and Jorge Lopez. I 
have also had helpful conversations with my wife Lynn concerning 
grammar and taste. Of course, remaining errors in grammar and 
mathematics are the responsibility of the author. 

Several users have supplied me with corrections and suggestions 
that I’ve incorporated in subsequent printings. I thank them all, 
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including Robert Messer of Albion College, who caught a subtle error 
in the proof of Theorem 12.1. 

Preface to the Second Edition After 32 years, it seemed time 
to revise this book. Since the first edition was so successful, I have 
retained the format and material from the first edition. The num¬ 
bering of theorems, examples, and exercises in each section will be 
the same, and new material will be added to some of the sections. 
Every rule has an exception, and this rule is no exception. In §11, 
a theorem (Theorem 11.2) has been added, which allows the sim¬ 
plification of four almost-identical proofs in the section: Examples 3 
and 4, Theorem 11.7 (formerly Corollary 11.4), and Theorem 11.8 
(formerly Theorem 11.7). 

Where appropriate, the presentation has been improved. See es¬ 
pecially the proof of the Chain Rule 28.4, the shorter proof of Abel’s 
Theorem 26.6, and the shorter treatment of decimal expansions in 
§16. Also, a few examples have been added, a few exercises have been 
modified or added, and a couple of exercises have been deleted. 

Here are the main additions to this revision. The proof of the 
irrationality of e in §16 is now accompanied by an elegant proof that 
7 r is also irrational. Even though this is an “enrichment” section, 
it is especially recommended for those who teach or will teach pre¬ 
college mathematics. The Baire Category Theorem and interesting 
consequences have been added to the enrichment §21. Section 31, on 
Taylor’s Theorem, has been overhauled. It now includes a discussion 
of Newton’s method for approximating zeros of functions, as well 
as its cousin, the secant method. Proofs are provided for theorems 
that guarantee when these approximation methods work. Section 35 
on Riemann-Stieltjes integrals has been improved and expanded. 
A new section, §38, contains an example of a continuous nowhere- 
differentiable function and a theorem that shows “most” continuous 
functions are nowhere differentiable. Also, each of §§22, 32, and 33 
has been modestly enhanced. 

It is a pleasure to thank many people who have helped over 
the years since the first edition appeared in 1980. This includes 
David M. Bloom, Robert B. Burckel, Kai Lai Chung, Mark Dalthorp 
(grandson), M. K. Das (India), Richard Dowds, Ray Hoobler, 
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Richard M. Koch, Lisa J. Madsen, Pablo V. Negron Marrero 
(Puerto Rico), Rajiv Monsurate (India), Theodore W. Palmer, Jiirg 
Ratz (Switzerland), Peter Renz, Karl Stromberg, and Jesus Sueiras 
(Puerto Rico). 

Special thanks go to my collaborator, Jorge M. Lopez, who pro¬ 
vided a huge amount of help and support with the revision. Working 
with him was also a lot of fun. My plan to revise the book was sup¬ 
ported from the beginning by my wife, Ruth Madsen Ross. Finally, 
I thank my editor at Springer, Kaitlin Leach, who was attentive to 
my needs whenever they arose. 

Especially for the Student: Don’t be dismayed if you run into 
material that doesn’t make sense, for whatever reason. It happens 
to all of us. Just tentatively accept the result as true, set it aside as 
something to return to, and forge ahead. Also, don’t forget to use the 
Index or Symbols Index if some terminology or notation is puzzling. 
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Introduction 



The underlying space for all the analysis in this book is the set of 
real numbers. In this chapter we set down some basic properties of 
this set. These properties will serve as our axioms in the sense that 
it is possible to derive all the properties of the real numbers using 
only these axioms. However, we will avoid getting bogged down in 
this endeavor. Some readers may wish to refer to the appendix on 
set notation. 


§1 The Set N of Natural Numbers 

We denote the set {1,2,3,...} of all positive integers by N. Each 
positive integer n has a successor, namely n + 1. Thus the successor 
of 2 is 3, and 37 is the successor of 36. You will probably agree that 
the following properties of N are obvious; at least the first four are. 

Nl. 1 belongs to N. 

N2. If n belongs to N, then its successor n + 1 belongs to N. 

N3. 1 is not the successor of any element in N. 


K.A. Ross, Elementary Analysis: The Theory of Calculus, 
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N4. If n and m in N have the same successor, then n = m. 

N5. A subset of N which contains 1, and which contains n + 1 
whenever it contains n, must equal N. 

Properties N1 through N5 are known as the Peano Axioms or 
Peano Postulates. It turns out most familiar properties of N can be 
proved based on these five axioms; see [ 8 ] or [39]. 

Let’s focus our attention on axiom N5, the one axiom that may 
not be obvious. Here is what the axiom is saying. Consider a subset 
S of N as described in N5. Then 1 belongs to S. Since S contains 
n + 1 whenever it contains n, it follows that S contains 2 = 1 + 1. 
Again, since S contains n + 1 whenever it contains n, it follows that 
S contains 3 = 2 + 1 . Once again, since S contains n + 1 whenever it 
contains n, it follows that S contains 4 = 3+1. We could continue this 
monotonous line of reasoning to conclude S contains any number in 
N. Thus it seems reasonable to conclude S = N. It is this reasonable 
conclusion that is asserted by axiom N5. 

Here is another way to view axiom N5. Assume axiom N5 is false. 
Then N contains a set S such that 

(i) 1 € 5, 

(ii) If n 6 S, then n + leS, 

and yet S ^ N. Consider the smallest member of the set {n E N : 
n 5}, call it no- Since (i) holds, it is clear no ^ 1. So no is a 
successor to some number in N, namely no — 1. We have no — 1 £ S' 
since no is the smallest member of {n 6 N : n ^ S}. By (ii), the 
successor of no — 1, namely no, is also in S, which is a contradiction. 
This discussion may be plausible, but we emphasize that we have not 
proved axiom N5 using the successor notion and axioms N1 through 
N4, because we implicitly used two unproven facts. We assumed 
every nonempty subset of N contains a least element and we assumed 
that if no 7 ^ 1 then no is the successor to some number in N. 

Axiom N5 is the basis of mathematical induction. Let P\,P 2 , 
+ 3 ,... be a list of statements or propositions that may or may 
not be true. The principle of mathematical induction asserts all the 
statements Pi, P2, P3, ■ ■ . are true provided 

(11) Hi is true, 

(1 2 ) Pt+i is true whenever P n is true. 
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We will refer to (Ii), i.e., the fact that P\ is true, as the basis for 
induction and we will refer to (I 2 ) as the induction step. For a sound 
proof based on mathematical induction, properties (Ii) and (I 2 ) must 
both be verified. In practice, (Ii) will be easy to check. 

Example 1 

Prove 1 + 2 + • • • + n = ~n(n + 1) for positive integers n. □ 

Solution 

Our nth proposition is 

P n : “1 + 2 H- 1 -n= ^n(n + 1).” 

Thus Pi asserts 1 = \ ■ 1(1 + 1 ), P 2 asserts 1 + 2 = 5 - 2(2 + 1), P 37 
asserts l + 2 + -- - + 37 = 5 ' 37(37 + 1) = 703, etc. In particular, Pi 
is a true assertion which serves as our basis for induction. 

For the induction step, suppose P n is true. That is, we suppose 

1 + 2 H-+ n = \n{n + 1 ) 

is true. Since we wish to prove P n . |_i from this, we add n + 1 to both 
sides to obtain 

1 + 2 H- hn+(n+l) = \n{n + 1) + (n + 1) 

= \ [n(n + 1 ) + 2 (n + 1 )] = \{n + 1 )(n + 2 ) 
= \{n + l)((n + 1 ) + 1 ). 

Thus P n -|-i holds if P n holds. By the principle of mathematical 
induction, we conclude P n is true for all n. □ 

We emphasize that prior to the last sentence of our solution we 
did not prove “P n +i is true.” We merely proved an implication: “if P n 
is true, then P n+ 1 is true.” In a sense we proved an infinite number 
of assertions, namely: Pi is true; if Pi is true then P 2 is true; if P 2 
is true then P 3 is true; if P 3 is true then P 4 is true; etc. Then we 
applied mathematical induction to conclude Pi is true, P 2 is true, P 3 
is true, P 4 is true, etc. We also confess that formulas like the one just 
proved are easier to prove than to discover. It can be a tricky matter 
to guess such a result. Sometimes results such as this are discovered 
by trial and error. 
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Example 2 

All numbers of the form 5 n — 4n — 1 are divisible by 16. □ 

Solution 

More precisely, we show 5 n — 4n — 1 is divisible by 16 for each n in 
N. Our nth proposition is 

P n : “5 n — 4n — 1 is divisible by 16.” 

The basis for induction Pi is clearly true, since 5 1 — 4 1 — 1 =0. 
Proposition P 2 is also true because 5 2 — 4 • 2 — 1 = 16, but note 
we didn’t need to check this case before proceeding to the induction 
step. For the induction step, suppose P n is true. To verify P n +i, the 
trick is to write 

5 n+1 - 4(n + 1) - 1 = 5(5 n - 4ra - 1) + 16m 

Since 5 n — 4n — 1 is a multiple of 16 by the induction hypothesis, it 
follows that 5 n+1 — 4(n + 1) — 1 is also a multiple of 16. In fact, if 
5 n — 4n — 1 = 16m, then 5 n+1 — 4(n +1) — 1 = 16 • (5 m + n). We have 
shown P n implies P n +i, so the induction step holds. An application 
of mathematical induction completes the proof. □ 

Example 3 

Show |sinrex| < n|sin.x| for all positive integers n and all real 
numbers x. □ 

Solution 

Our nth proposition is 

P n : “| sinnx| < n\ sin x| for all real numbers x. v 

The basis for induction is again clear. Suppose P n is true. We apply 
the addition formula for sine to obtain 

| sin(n + 1)®| = | sin(mc + x)| = | sin nx cos x + cos me sin x|. 

Now we apply the Triangle Inequality and properties of the absolute 
value [see Theorems 3.7 and 3.5] to obtain 

| sin(n + l)x| < | sinmr| • | cosx| + | cosmc| • | sinx|. 

Since | cosy\ < 1 for all y we see that 
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Now we apply the induction hypothesis P n to obtain 

| sin(n + V)x\ < n| sinx| + | sinx| = (n + 1 )| sinx|. 

Thus P n +i holds. Finally, the result holds for all n by mathematical 
induction. □ 


Exercises 

1.1 Prove l 2 + 2 2 + - • - + n 2 = |n(n+ l)(2n +1) for all positive integers n. 

1.2 Prove 3 + 11 + • • • + (8n — 5) = 4n 2 — n for all positive integers n. 

1.3 Prove 1 3 + 2 3 H- \-n 3 = (1 + 2H-bn) 2 for all positive integers n. 

1.4 (a) Guess a formula for 1 + 3 + • • • + (2n — 1) by evaluating the sum 

for n = 1, 2, 3, and 4. [For n = 1, the sum is simply 1.] 

(b) Prove your formula using mathematical induction. 

1.5 Prove 1 + \ + \ H-+ ^ = 2 — A- for all positive integers n. 

1.6 Prove (ll) n — 4" is divisible by 7 when n is a positive integer. 

1.7 Prove 7 n — 6n — 1 is divisible by 36 for all positive integers n. 

1.8 The principle of mathematical induction can be extended as follows. 
A list P m ,P m+ i ,... of propositions is true provided (i) P m is true, 
(ii) P n+ 1 is true whenever P n is true and n> m. 

(a) Prove n 2 > n + 1 for all integers n > 2. 

(b) Prove n! > n 2 for all integers n > 4. [Recall n! = n(n— 1) • • • 2• 1; 
for example, 5! = 5- 4- 3- 2- l = 120.] 

1.9 (a) Decide for which integers the inequality 2" > n 2 is true. 

(b) Prove your claim in (a) by mathematical induction. 

1.10 Prove (2 n + 1) + (2 n + 3) + (2 n + 5) + • • • + (4n — 1) = 3n 2 for all 
positive integers n. 

1.11 For each n £ N, let P n denote the assertion “n 2 + 5n + 1 is an even 
integer.” 

(a) Prove P„+i is true whenever P n is true. 

(b) For which n is P n actually true? What is the moral of this 
exercise? 
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1.12 For neN, let n! [read “n factorial”] denote the product 1-2-3 ■ ■ - n. 
Also let 0! = 1 and define 

,.m for k = 0,l,...,n. (1.1) 


k\(n — k)\ 

The binomial theorem asserts that 

(„ +1 ,)»=Q.» + Q«- , 6+ Q«—e+ ■ +( n n _ 1 )a^ + (y 


=a n +na n - 1 b+-n(n-l)a n - 2 b 2 + • - - +nab n ~ 1 +b n . 


(a) Verify the binomial theorem for n = 1,2, and 3. 

(b) Show G) + ( t y = (”+') for * = 1,2.n. 

(c) Prove the binomial theorem using mathematical induction and 
part (b). 


§2 The Set Q of Rational Numbers 

Small children first learn to add and to multiply positive integers. 
After subtraction is introduced, the need to expand the number sys¬ 
tem to include 0 and negative integers becomes apparent. At this 
point the world of numbers is enlarged to include the set Z of all 
integers. Thus we have Z = {0,1, —1, 2, —2,...}. 

Soon the space Z also becomes inadequate when division is in¬ 
troduced. The solution is to enlarge the world of numbers to include 
all fractions. Accordingly, we study the space Q of all rational num¬ 
bers , i.e., numbers of the form ^ where m, n G Z and n / 0. Note 
that Q contains all terminating decimals such as 1.492 = . The 

connection between decimals and real numbers is discussed in 10.3 
on page 58 and in §16. The space Q is a highly satisfactory alge¬ 
braic system in which the basic operations addition, multiplication, 
subtraction and division can be fully studied. No system is perfect, 
however, and Q is inadequate in some ways. In this section we will 
consider the defects of Q. In the next section we will stress the good 
features of Q and then move on to the system of real numbers. 

The set Q of rational numbers is a very nice algebraic system until 
one tries to solve equations like x 2 = 2. It turns out that no rational 
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number satisfies this equation, and yet there are good reasons to 
believe some kind of number satisfies this equation. Consider, for 
example, a square with sides having length one; see Fig. 2.1. If d is 
the length of the diagonal, then from geometry we know 1 2 + 1 2 = d 2 , 
i.e., d 2 = 2. Apparently there is a positive length whose square is 2, 
which we write as y/2. But y/2 cannot be a rational number, as we will 
show in Example 2. Of course, y/2 can be approximated by rational 
numbers. There are rational numbers whose squares are close to 2; 
for example, (1.4142) 2 = 1.99996164 and (1.4143) 2 = 2.00024449. 

It is evident that there are lots of rational numbers and yet there 
are “gaps” in Q. Here is another way to view this situation. Consider 
the graph of the polynomial x 2 — 2 in Fig. 2.2. Does the graph of x 2 — 2 
cross the x-axis? We are inclined to say it does, because when we 
draw the x-axis we include “all” the points. We allow no “gaps.” But 
notice that the graph of x 2 — 2 slips by all the rational numbers on 
the x-axis. The x-axis is our picture of the number line, and the set 
of rational numbers again appears to have significant “gaps.” 

There are even more exotic numbers such as ir and e that are not 
rational numbers, but which come up naturally in mathematics. The 
number n is basic to the study of circles and spheres, and e arises in 
problems of exponential growth. 

We return to y/2. This is an example of what is called an algebraic 
number because it satisfies the equation x 2 — 2 = 0. 
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FIGURE 2.2 


2.1 Definition. 

A number is called an algebraic number if it satisfies a polynomial 
equation 


c n x n + c n -ix n 1 H-h C\X + c 0 = 0 

where the coefficients co, ci,..., c n are integers, c n ^ 0 and n > 1. 

Rational numbers are always algebraic numbers. In fact, if r = — 
is a rational number [m,n 6 Z and n ^ 0], then it satisfies the 
equation nx — m = 0. Numbers defined in terms of y/, y/~, etc. [or 
fractional exponents, if you prefer] and ordinary algebraic operations 
on the rational numbers are invariably algebraic numbers. 


Example 1 

j4f, V3, v^ 17, \/2 + \/5 and y ^ 4-2 ^ 3 are algebraic numbers. In fact, 
^ is a solution of 17x — 4 = 0, \/3 is a solution of a; 2 — 3 = 0, and 

17 is a solution of x 3 — 17 = 0. The expression a = \f 2 + means 
a 2 = 2 + v^5 or a 2 — 2 = v^5 so that (a 2 — 2 ) 3 = 5. Therefore we 
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have a 6 — 6a 4 + 12a 2 — 13 = 0, which shows a = \J2 + \/5 satisfies 
the polynomial equation x 6 — 6x 4 + 12x 2 — 13 = 0. 

Similarly, the expression b = J 4 ~ 2v ^ leads to 7b 2 = 4 — 2v/3, 

hence 2\/3 = 4 — 7b 2 , hence 12 = (4 — 7b 2 ) 2 , hence 496 4 —566 2 ±4 = 0. 
Thus b satisfies the polynomial equation 49x 4 — 56x 2 + 4 = 0. □ 

The next theorem may be familiar from elementary algebra. It is 
the theorem that justifies the following remarks: the only possible ra¬ 
tional solutions of x 3 —7x 2 +2x —12 = 0 are ±1, ±2, ±3, ±4, ±6, ±12, 
so the only possible (rational) monomial factors of x 3 — 7x 2 + 2x — 12 
are x — 1, x + 1, x — 2, x + 2, x — 3, x + 3, x — 4, x + 4, x — 6, x + 6, 
x — 12, x + 12. We won’t pursue these algebraic problems; we merely 
make these observations in the hope they will be familiar. 

The next theorem also allows one to prove algebraic numbers that 
do not look like rational numbers are usually not rational numbers. 
Thus y/4 is obviously a rational number, while y/2, y/3, \/5, etc. 
turn out to be nonrational. See the examples following the theorem. 
Also, compare Exercise 2.7. Recall that an integer k is a factor of an 
integer m or divides rn if ^ is also an integer. 

If the next theorem seems complicated, first read the special case 
in Corollary 2.3 and Examples 2-5. 

2.2 Rational Zeros Theorem. 

Suppose Co, ci,..., Cn are integers and r is a rational number 
satisfying the polynomial equation 

c n x n + c n -ix n ~ l H-h cix ± c 0 = 0 (1) 

where n > 1. c n ^ 0 and cq ^ 0. Let r = | where c, d are inte¬ 
gers having no common factors and d ^ 0. Then c divides Co and d 
divides c n . 

In other words, the only rational candidates for solutions of (1) 
have the form ^ where c divides Co and d divides c n . 

Proof 

We are given 

(iV +—G) — 
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We multiply through by d n and obtain 

c n c n + c n _ic n_1 d + c n _2C n_ 2 d 2 H- \-C2C 2 d n ~ 2 + cicd n ~ 1 + cod n = 0 . 

(2) 

If we solve for co«f\ we obtain 

c 0 d n = -c[c n c n_1 + c n _ic n_2 d+c n _ 2 C n_3 d 2 H- \-c 2 cd n ~ 2 + cid n_1 ]. 

It follows that c divides cq d n . But c and d n have no common factors, 
so c divides cq. This follows from the basic fact that if an integer 
c divides a product ab of integers, and if c and b have no common 
factors, then c divides a. See, for example, Theorem 1.10 in [50]. 
Now we solve (2) for c n c n and obtain 

c n c n = -d[c n _ic n_1 +c n _ 2 c ?l_2 dH- \-c 2 c 2 d n '~ 3 +cicd n ~ 2 +c 0 d n ~ 1 ]. 

Thus d divides c n c n . Since c n and d have no common factors, 
d divides c n . ■ 

2.3 Corollary. 

Consider the polynomial equation 

x n + c n -ix n ~ l H-h cix + c 0 = 0, 

where the coefficients co,ci,... , c n _i are integers and Co ^ 0. 1 Any 
rational solution of this equation must be an integer that divides Co. 

Proof 

In the Rational Zeros Theorem 2.2, the denominator of r must divide 
the coefficient of x n , which is 1 in this case. Thus r is an integer and 
it divides Co- ■ 

Example 2 

\/2 is not a rational number. □ 

Proof 

By Corollary 2.3, the only rational numbers that could possibly be 
solutions of x 2 — 2 = 0 are ±1,±2. [Here n = 2, C 2 = 1, ci = 0, 
cq = —2 . So the rational solutions have the form ^ where c divides 


1 Polynomials like this, where the highest power has coefficient 1, are called monic 

polynomials. 
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Co = —2 and d divides c-i = 1.] One can substitute each of the four 
numbers ± 1,±2 into the equation x 2 — 2 = 0 to quickly eliminate 
them as possible solutions of the equation. Since y/2 is a solution of 
x 2 — 2 = 0, it cannot be a rational number. ■ 

Example 3 

\/l7 is not a rational number. □ 

Proof 

The only possible rational solutions of x 2 — 17 = 0 are ±1, ±17, and 
none of these numbers are solutions. ■ 


Example 4 

^6 is not a rational number. □ 


Proof 

The only possible rational solutions of x 3 — 6 = 0 are ±1, ±2, ±3, ± 6 . 
It is easy to verify that none of these eight numbers satisfies the 
equation x 3 — 6 = 0 . ■ 

Example 5 

a = \/2 + ^5 is not a rational number. □ 


Proof 

In Example 1 we showed a is a solution of x 6 — 6 x 4 + 12x 2 — 13 = 0. 
By Corollary 2.3, the only possible rational solutions are ±1,±13. 
When x = 1 or —1, the left hand side of the equation is —6 and 
when x = 13 or —13, the left hand side of the equation turns out to 
equal 4,657,458. This last computation could be avoided by using a 
little common sense. Either observe a is “obviously” bigger than 1 
and less than 13, or observe 

13 6 — 6 • 13 4 + 12 • 13 2 - 13 = 13(13 5 - 6 ■ 13 3 + 12 • 13 - 1) ^ 0 

since the term in parentheses cannot be zero: it is one less than some 
multiple of 13. ■ 


Example 6 

b = \J A ~ 2 ^ 3 is not a rational number. 


□ 
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Proof 

In Example 1 we showed b is a solution of 49a; 4 — 56x 2 + 4 = 0. By 
Theorem 2.2, the only possible rational solutions are 

±1, ±1/7, ±1/49, ±2, ±2/7, ±2/49, ±4, ±4/7, ±4/49. 

To complete our proof, all we need to do is substitute these 18 can¬ 
didates into the equation 49x 4 — 56x 2 ±4 = 0. This prospect is 
so discouraging, however, that we choose to find a more clever ap¬ 
proach. In Example 1, we also showed 12 = (4 — 7b 2 ) 2 . Now if b were 
rational, then 4 — 7fe 2 would also be rational [Exercise 2.6], so the 
equation 12 = x 2 would have a rational solution. But the only pos¬ 
sible rational solutions to x 2 — 12 = 0 are ±1, ±2, ±3, ±4, ±6, ±12, 
and these all can be eliminated by mentally substituting them into 
the equation. We conclude 4 — 7b 2 cannot be rational, so b cannot 
be rational. ■ 

As a practical matter, many or all of the rational candidates given 
by the Rational Zeros Theorem can be eliminated by approximating 
the quantity in question. It is nearly obvious that the values in Ex¬ 
amples 2 through 5 are not integers, while all the rational candidates 
are. The number b in Example 6 is approximately 0.2767; the nearest 
rational candidate is +2/7 which is approximately 0.2857. 

It should be noted that not all irrational-looking expressions are 
actually irrational. See Exercise 2.7. 

2.4 Remark. 

While admiring the efficient Rational Zeros Theorem for finding 
rational zeros of polynomials with integer coefficients, you might 
wonder how one would find other zeros of these polynomials, or ze¬ 
ros of other functions. In §31, we will discuss the most well-known 
method, called Newton’s method, and its cousin, the secant method. 
That discussion can be read now; only the proof of the theorem uses 
material from §31. 


Exercises 

2.1 Show a/3, "\/5, a/T, a/24, and \/31 are not rational numbers. 

2.2 Show s/2, and -\/T3 are not rational numbers. 
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2.3 Show a/2 + a/ 2 is not a rational number. 

2.4 Show \/5 — V3 is not a rational number. 

2.5 Show [3 + y/2] 2 / 3 is not a rational number. 

2.6 In connection with Example 6, discuss why 4 — 7b 2 is rational if b is 
rational. 

2.7 Show the following irrational-looking expressions are actually rational 
numbers: (a) \A + 2y/3 — \/3, and (b) \/6 + 4-\/2 — \/2. 

2.8 Find all rational solutions of the equation x 8 — 4x 5 + 13x 3 — 7x +1 = 0. 


§3 The Set R of Real Numbers 

The set Q is probably the largest system of numbers with which 
you really feel comfortable. There are some subtleties but you have 
learned to cope with them. For example, Q is not simply the set of 
symbols m/n, where m,n£Z,n/ 0, since we regard some pairs of 
different looking fractions as equal. For example, - and | represent 
the same element of Q. A rigorous development of Q based on Z, 
which in turn is based on N, would require us to introduce the notion 
of equivalence classes. In this book we assume a familiarity with and 
understanding of Q as an algebraic system. However, in order to 
clarify exactly what we need to know about Q, we set down some of 
its basic axioms and properties. 

The basic algebraic operations in Q are addition and multiplica¬ 
tion. Given a pair a, b of rational numbers, the sum a + b and the 
product ab also represent rational numbers. Moreover, the following 
properties hold. 

Al. a + (b + c) = (a + b) + c for all a, b, c. 

A2. a + b = b + a for all a, b. 

A3, a + 0 = a for all a. 

A4. For each a, there is an element —a such that a + (—a) = 0. 

Ml. a(bc) = ( ab)c for all a,b,c. 

M2, ab = ba for all a, b. 
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M3, a • 1 = a for all a. 

M4. For each a ^ 0, there is an element a -1 such that aa -1 = 1. 

DL a(b + c) = ab + ac for all a, b, c. 

Properties A1 and Ml are called the associative laws, and prop¬ 
erties A2 and M2 are the commutative laws. Property DL is the 
distributive law, this is the least obvious law and is the one that 
justifies “factorization” and “multiplying out” in algebra. A system 
that has more than one element and satisfies these nine properties is 
called a field. The basic algebraic properties of Q can proved solely 
on the basis of these field properties. We will not pursue this topic 
in any depth, but we illustrate our claim by proving some familiar 
properties in Theorem 3.1 below. 

The set Q also has an order structure < satisfying 

Ol. Given a and b, either a < b or b < a. 

02. If a < b and b < a, then a = b. 

03. If a < b and b < c, then a < c. 

04. If a < b, then a + c < b + c. 

05. If a < b and 0 < c, then ac < be. 

Property 03 is called the transitive law. This is the characteristic 
property of an ordering. A field with an ordering satisfying properties 
01 through 05 is called an ordered field. Most of the algebraic and 
order properties of Q can be established for an ordered field. We will 
prove a few of them in Theorem 3.2 below. 

The mathematical system on which we will do our analysis will 
be the set R of all real numbers. The set R will include all rational 
numbers, all algebraic numbers, it, e, and more. It will be a set that 
can be drawn as the real number line; see Fig. 3.1. That is, every 
real number will correspond to a point on the number line, and 
every point on the number line will correspond to a real number. 
In particular, unlike Q, R will not have any “gaps.” We will also 
see that real numbers have decimal expansions; see 10.3 on page 58 
and §16. These remarks help describe R, but we certainly have not 
defined Rasa precise mathematical object. It turns out that R can 
be defined entirely in terms of the set Q of rational numbers; we 
indicate in the enrichment §6 one way this can be done. But then 
it is a long and tedious task to show how to add and multiply the 
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FIGURE 3.1 

objects defined in this way and to show that the set R, with these 
operations, satisfies all the familiar algebraic and order properties 
we expect to hold for R. To develop R properly from Q in this way 
and to develop Q properly from N would take us several chapters. 
This would defeat the purpose of this book, which is to accept R as 
a mathematical system and to study some important properties of 
R and functions on R. Nevertheless, it is desirable to specify exactly 
what properties of R we are assuming. 

Real numbers, i.e., elements of R, can be added together and 
multiplied together. That is, given real numbers a and 6, the sum 
a+b and the product ab also represent real numbers. Moreover, these 
operations satisfy the field properties A1 through A4, Ml through 
M4, and DL. The set R also has an order structure < that satisfies 
properties 01 through 05. Thus, like Q, R is an ordered field. 

In the remainder of this section, we will obtain some results for 
R that are valid in any ordered field. In particular, these results 
would be equally valid if we restricted our attention to Q. These 
remarks emphasize the similarities between R and Q. We have not 
yet indicated how R can be distinguished from Q as a mathematical 
object, although we have asserted that R has no “gaps.” We will 
make this observation much more precise in the next section, and 
then we will give a “gap filling” axiom that finally will distinguish R 
from Q. 

3.1 Theorem. 

The following are consequences of the field properties: 

(i) a + c = b + c implies a = b; 

(ii) a ■ 0 = 0 for all a; 

(iii) {—a)b = —ab for all a, b; 

(iv) (—a)(— b) = ab for all a,b; 

(v) ac = be and 0 imply a = b; 

(vi) ab = 0 implies either a = 0 or b = 0; 
for a,b,c £ R. 
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Proof 

(i) a + c = b + c implies (a + c) + (—c) = (b + c) + (—c), so by Al, 
we have a+ [c+ (—c)] = b+ [c+ (—c)]. By A4, this reduces to 
a + 0 = 6 + 0, so a = 6 by A3. 

(ii) We use A3 and DL to obtain a-0 = a-(0 + 0) = a- 0 + a-0, 
so0 + a- 0 = a- 0 + a-0. By (i) we conclude 0 = a ■ 0. 

(iii) Since a + (—a) = 0, we have ab + (— a)b = [a + (—a)] • b = 
0 • b = 0 = ab + (—( ab )). From (i) we obtain (— a)b = —( ab ). 

(iv) and (v) are left to Exercise 3.3. 

(vi) If ab = 0 and b ^ 0, then 0 = 6 _1 -0 = 0- b^ 1 = (ab) ■ 6 _1 = 
a(6fe _1 ) = a ■ 1 = a. ■ 


3.2 Theorem. 

The following are consequences of the properties of an ordered field: 

(i) If a, <b, then —b < — a; 

(ii) If a < b and c < 0, then be < ac; 

(iii) 7/0 < a and 0 < b, then 0 < ab; 

(iv) 0 < a 2 for all a; 

(v) 0 < 1; 

(vi) 7/0 < a, then 0 < a 1 ; 

(vii) If 0 < a < b, then 0 < b < a -1 ; 
for a,b,c 6 M. 

Note a < b means a < b and a b. 


Proof 

(i) Suppose a < b. By 04 applied to c = (—a) + (—6), we have 
a + [(— a) + (— b)} < b + [(— a) + (— b)]. It follows that —6 < —a. 

(ii) If a < b and c < 0, then 0 < —c by (i). Now by 05 we have 
a(—c) < b(—c ), i.e., —ac < —be. From (i) again, we see be < ac. 

(iii) If we put a = 0 in property 05, we obtain: 0 < b and 0 < c 
imply 0 < be. Except for notation, this is exactly assertion 

(iii). 

(iv) For any a, either a > 0 or a < 0 by 01. If a > 0, then a 2 > 0 
by (iii). If a < 0, then we have —a > 0 by (i), so (—a) 2 > 0, 
i.e., a 2 > 0. 

(v) Is left to Exercise 3.4. 
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(vi) Suppose 0 < a but 0 < a -1 fails. Then we must have a -1 < 0 
and 0 < —a -1 . Now by (iii) 0 < a(—a -1 ) = —1, so that 1 < 0, 
contrary to (v). 

(vii) Is left to Exercise 3.4. ■ 

Another important notion that should be familiar is that of 
absolute value. 

3.3 Definition. 

We define 

|a| = a if a > 0 and |a| = —a if a < 0. 

|a| is called the absolute value of a. 

Intuitively, the absolute value of a represents the distance be¬ 
tween 0 and a, but in fact we will define the idea of “distance” in 
terms of the “absolute value,” which in turn was defined in terms of 
the ordering. 

3.4 Definition. 

For numbers a and b we define dist(a, b ) = |a—6|; dist(a, b ) represents 
the distance between a and b. 

The basic properties of the absolute value are given in the next 
theorem. 

3.5 Theorem. 

(i) |a| > 0 for all a£l. 

(ii) \ab\ = |a| • \b\ for all a, b E M. 

(iii) |a + b\ < |a| + \b\ for all a, b € M. 

Proof 

(i) is obvious from the definition. [The word “obvious” as used 
here signifies the reader should be able to quickly see why the 
result is true. Certainly if a > 0, then |a| = a > 0, while a < 0 
implies |a| = —a > 0. We will use expressions like “obviously” 
and “clearly” in place of very simple arguments, but we will 
not use these terms to obscure subtle points.] 
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(ii) There are four easy cases here. If a > 0 and b > 0, then ab > 0, 
so |a| • |6| = ab = \ab\. If a < 0 and b < 0, then —a > 0, — b > 0 
and (—a)(— b) > 0 so that |a| • |6| = (—a)(— b) = ab = \ab\. 
If a > 0 and b < 0, then —b > 0 and a(— b) > 0 so that 
|a| • |6| = a{—b ) = —{ab) = |a6|. If a < 0 and b > 0, then 
—a > 0 and {—a)b > 0 so that |a| • \b\ = {—a)b = — ab = |ab|. 
(iii) The inequalities — |a| < a < |a| are obvious, since either 
a = |a| or else a = —|a|. Similarly —16| < b < \b\. Now four 
applications of 04 yield 

— |a| + (—16|) < a + b < |a| + b < |a| + \b\ 

so that 

-(|a| + |6|) < a + b < |a| + |6|. 

This tells us a + b < |a| + \b\ and also —{a + b) < |a| + |6|. 
Since \a + b\ is equal to either a + b or —{a + b), we conclude 
|a + b\ < |a| + |6|. ■ 

3.6 Corollary. 

dist(a, c) < dist(a, b) + dist(6, c) for all a,b,c €E M. 

Proof 

We can apply inequality (iii) of Theorem 3.5 to a — b and b — c to 
obtain \{a — b) + {b — c)| < \a — b\ + \b — c\ or dist(a,c) = \a — c\ < 
|a — 6| + \b — c\ < dist(a, b) + dist(6, c). ■ 

The inequality in Corollary 3.6 is very closely related to an 
inequality concerning points a, b, c in the plane, and the latter in¬ 
equality can be interpreted as a statement about triangles: the length 
of a side of a triangle is less than or equal to the sum of the lengths 
of the other two sides. See Fig. 3.2. For this reason, the inequality 
in Corollary 3.6 and its close relative (iii) in Theorem 3.5 are often 
called the Triangle Inequality. 

3.7 Triangle Inequality. 

|a + b\ < |a| + \b\ for all a, b. 

A useful variant of the triangle inequality is given in Exer¬ 
cise 3.5(b). 
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Exercises 

3.1 (a) Which of the properties A1-A4, M1-M4, DL, 01-05 fail for N? 
(b) Which of these properties fail for Z? 

3.2 (a) The commutative law A2 was used in the proof of (ii) in 

Theorem 3.1. Where? 

(b) The commutative law A2 was also used in the proof of (iii) in 
Theorem 3.1. Where? 

3.3 Prove (iv) and (v) of Theorem 3.1. 

3.4 Prove (v) and (vii) of Theorem 3.2. 

3.5 (a) Show |&| < a if and only if —a < b < a. 

(b) Prove ||a| — |6|| < |a — 6| for all a, b € R. 

3.6 (a) Prove |a + b + c\ < |a| + |&| + |c| for all a, b, c £ R. Hint: Apply the 

triangle inequality twice. Do not consider eight cases. 

(b) Use induction to prove 

|<2-1 + 0,2 + • ' • + a n \ < |Ot-i | + |Cl2 | + ‘ ‘ ' + \&n\ 

for n numbers aq, < 22 ,..., a n . 

3.7 (a) Show |6| < a if and only if — a < b < a. 

(b) Show \a — b\ < c if and only if 6 — c < a < b + c. 

(c) Show \a — b\ < c if and only if b — c < a < b + c. 

3.8 Let a, b € R. Show if a < b\ for every b\ > b , then a < b. 
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§4 The Completeness Axiom 

In this section we give the completeness axiom for R. This is the 
axiom that will assure us R has no “gaps.” It has far-reaching conse¬ 
quences and almost every significant result in this book relies on it. 
Most theorems in this book would be false if we restricted our world 
of numbers to the set Q of rational numbers. 

4.1 Definition. 

Let S be a nonempty subset of R. 

(a) If S contains a largest element so [that is, so belongs to S and 
s < s o for all s £ S'], then we call so the maximum of S and 
write so = maxS. 

(b) If S contains a smallest element, then we call the smallest 
element the minimum of S and write it as min S. 

Example 1 

(a) Every finite nonempty subset of R has a maximum and a 
minimum. Thus 

maxjl, 2, 3,4, 5} = 5 and min{l, 2, 3,4,5} = 1, 
max{0,7T, —7, e, 3,4/3} = 7T and min{0,7r, —7, e, 3,4/3} = —7, 
max{n £ Z : —4 < n < 100} = 100 and 
minjra £ Z : —4 < n < 100} = —3. 

(b) Consider real numbers a and b where a < b. The following 
notation will be used throughout 

[a, b] = {x £ R : a < x < b}, (a, b) = {x £ R : a < x < b}, 

[a, b) = {x £ R : a < x < b}, (a, b] = {x £ R : a < x < b}. 

[a, 6] is called a closed interval , (a, b) is called an open interval, 
while [a, b) and (a, b] are called half-open or semi-open intervals. 
Observe max[a, b] = b and min[a, b] = a. The set (a, b) has no 
maximum and no minimum, since the endpoints a and b do not 
belong to the set. The set [a, b) has no maximum, but a is its 
minimum. 

(c) The sets Z and Q have no maximum or minimum. The set N 
has no maximum, but minN = 1. 
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(d) The set {r E Q : 0 < r < y/2} has a minimum, namely 0, but 
no maximum. This is because y/2 does not belong to the set, 
but there are rationals in the set arbitrarily close to \/2. 

(e) Consider the set : n E N}. This is shorthand for the 

set 

{l- 1 ,2,3- 1 ,4,5- 1 ,6,7- 1 ,...} = {l,2,i,4,i,6,i,...}. 

The set has no maximum and no minimum. □ 

4.2 Definition. 

Let S be a nonempty subset of M. 

(a) If a real number M satisfies s < M for all s E S', then M is 
called an upper bound of S and the set S is said to be bounded 
above. 

(b) If a real number m satisfies m < s for all s E S, then m is 
called a lower bound of S and the set S is said to be bounded 
below. 

(c) The set S is said to be bounded if it is bounded above and 
bounded below. Thus S is bounded if there exist real numbers 
m and M such that S C [m, M]. 

Example 2 

(a) The maximum of a set is always an upper bound for the set. 
Likewise, the minimum of a set is always a lower bound for the 
set. 

(b) Consider a, b in M, a < b. The number b is an upper bound for 
each of the sets [a, b], (a, 6), [a, b), ( a,b\. Every number larger 
than b is also an upper bound for each of these sets, but b is 
the smallest or least upper bound. 

(c) None of the sets Z, Q and N is bounded above. The set N is 
bounded below; 1 is a lower bound for N and so is any number 
less than 1. In fact, 1 is the largest or greatest lower bound. 

(d) Any nonpositive real number is a lower bound for {r E Q : 
0 < r < \/2} and 0 is the set’s greatest lower bound. The least 
upper bound is y/2. 

(e) The set : n E N} is not bounded above. Among its 

many lower bounds, 0 is the greatest lower bound. □ 
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We now formalize two notions that have already appeared in 
Example 2. 

4.3 Definition. 

Let S' be a nonempty subset of M. 

(a) If S is bounded above and S has a least upper bound, then we 
will call it the supremum of S and denote it by supS. 

(b) If S is bounded below and S has a greatest lower bound, then 
we will call it the infimum of S and denote it by inf S. 

Note that, unlike maxS and rninS, supS and infS need not 
belong to S. Note also that a set can have at most one maximum, 
minimum, supremum and infimum. Sometimes the expressions “least 
upper bound” and “greatest lower bound” are used instead of the 
Latin “supremum” and “infimum” and sometimes supS is written 
lub S and inf S is written gib S. We have chosen the Latin termi¬ 
nology for a good reason: We will be studying the notions “lim sup” 
and “lim inf” and this notation is completely standard; no one writes 
“lim lub” for instance. 

Observe that if S is bounded above, then M = sup S if and only 
if (i) s < M for all s £ S, and (ii) whenever M\ < M , there exists 
si G S such that si > M\. 

Example 3 

(a) If a set S has a maximum, then rnaxS = supS. A similar 
remark applies to sets that have infimums. 

(b) If a, b € M and a <6, then 

sup[a, b] = sup (a, 6) = sup[a, b) = sup(a,6] = b. 

(c) As noted in Example 2, we have infN = 1. 

(d) IfA = {r€E(Q>:0<r< \/2}, then sup A = \/2 and inf A = 0. 

(e) We have inf{n^ -1 ^ : n € N} = 0. □ 

Example 4 

(a) The set A = : n £ N and n > 3} is bounded above and 

bounded below. It has a maximum, namely g, but it has no 
minimum. In fact, sup(A) = | and inf (A) = 0. 
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(b) The set B = {r £ Q : r 3 < 7} is bounded above, by 2 for 
example. It does not have a maximum, because r 3 ^ 7 for all 
r 6 Q, by the Rational Zeros Theorem 2.2. However, sup(-B) = 
y/l. The set B is not bounded below; if this isn’t obvious, think 
about the graph of y = x 3 . Clearly B has no minimum. Starting 
with the next section, we would write inf (5) = —oo. 

(c) The set C = {m T ny/ 2 : m, n 6 Z} isn’t bounded above or 
below, so it has no maximum or minimum. We could write 
sup(C') = Too and inf(C) = —oo. 

(d) The set D = (x € M : x 2 < 10} is the open interval 

(—%/10, vTo). Thus it is bounded above and below, but it 
has no maximum or minimum. However, inf (D) = — y/lO and 
sup(.D) = Vio. □ 


Note that, in Examples 2-4, every set S that is bounded above 
possesses a least upper bound, i.e., sup S exists. This is not an acci¬ 
dent. Otherwise there would be a “gap” between the set S and the 
set of its upper bounds. 


4.4 Completeness Axiom. 

Every nonempty subset S o/M that is bounded above has a least upper 
bound. In other words, sup S exists and is a real number. 


The completeness axiom for Q would assert that every nonempty 
subset of Q, that is bounded above by some rational number, has a 
least upper bound that is a rational number. The set A = {r E Q : 
0 < r < y/2} is a set of rational numbers and it is bounded above by 
some rational numbers [3/2 for example], but A has no least upper 
bound that is a rational number. Thus the completeness axiom does 
not hold for Q! Incidentally, the set A can be described entirely in 
terms of rationals: 4 = {r£Q:0<r and r 2 < 2}. 

The completeness axiom for sets bounded below comes free. 


4.5 Corollary. 

Every nonempty subset S of M that is bounded below has a greatest 
lower bound inf S. 
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Proof 

Let —S' be the set {—s : s £ S}; — S consists of the negatives of the 
numbers in S. Since S is bounded below there is an m in M such 
that m < s for all s £ S. This implies —m > —s for all s £ S, 
so — mn > u for all u in the set —S. Thus —S is bounded above by 
—77i. The Completeness Axiom 4.4 applies to —S, so sup(—S) exists. 
Figure 4.1 suggests we prove inf S = — sup(—S). 

Let so = sup (—5); we need to prove 

— so < s for all s £ S, (1) 

and 

if t < s for all s € S, then t < —so- (2) 

The inequality (1) will show —so is a lower bound for S, while (2) 
will show —so is the greatest lower bound, that is, —so = inf S. We 
leave the proofs of (1) and (2) to Exercise 4.9. ■ 

It is useful to know: 

if a > 0, then — < a for some positive integer n, (*) 

n 

and 

if b > 0, then b < n for some positive integer n. (**) 

These assertions are not as obvious as they may appear. If fact, there 
exist ordered fields that do not have these properties. In other words, 
there exists a mathematical system satisfying all the properties Al- 
A4, M1-M4, DL and 01-05 in §3 and yet possessing elements a > 0 
and b > 0 such that a <l/n and n < b for all n. On the other hand, 
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such strange elements cannot exist in K or Q. We next prove this; in 
view of the previous remarks we must expect to use the Completeness 
Axiom. 

4.6 Archimedean Property. 

If a > 0 and b > 0 , then for some positive integer n, we have na > b. 

This tells us that, even if a is quite small and b is quite large, 
some integer multiple of a will exceed b. Or, to quote [4], given enough 
time, one can empty a large bathtub with a small spoon. [Note that 
if we set b = 1, we obtain assertion (*), and if we set a = 1, we 
obtain assertion (**).] 

Proof 

Assume the Archimedean property fails. Then there exist a > 0 and 
b > 0 such that na < b for all n E N. In particular, b is an upper 
bound for the set S = {na : n E N}. Let so = sup S'; this is where we 
are using the completeness axiom. Since a > 0, we have so < so + a > 
so so — fl < so- [To be precise, we obtain so < so + a and so — a < so 
by property 04 and the fact that a + (—a) = 0. Then we conclude 
so — a < so since so — a = sq implies a = 0 by Theorem 3.1 (i).] Since 
so is the least upper bound for S, so — a cannot be an upper bound 
for S. It follows that so — a < n^a for some no E N. This implies 
s 0 < (no + l)a. Since (no + l)a is in S, so is not an upper bound 
for S and we have reached a contradiction. Our assumption that the 
Archimedean property fails was wrong. ■ 

We give one more result that seems obvious from our experi¬ 
ence with the real number line, but which cannot be proved for an 
arbitrary ordered field. 

4.7 Denseness of Q. 

If a, b E M and a < b, then there is a rational r E Q such that 
a < r < b. 

Proof 

We need to show a < ^ < b for some integers m and n where n > 0, 
and thus we need 


an < m < bn. 


( 1 ) 
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Since b — a > 0, the Archimedean property shows there exists an 
n € N such that 

n{b — a) > 1 , and hence bn — an > 1 . (2) 

From this, it is fairly evident that there is an integer m between an 
and bn, so that (1) holds. However, the proof that such an m exists is 
a little delicate. We argue as follows. By the Archimedean property 
again, there exists an integer k > max{|an|, |fen|}, so that 

—k < an < bn < k. 

Then the sets K = {j E Z : —k < j < k} and {j 6 K : an < j} 
are finite, and they are nonempty, since they both contain k. Let 
m = minjj £ K : an < j}. Then —k < an < m. Since m > —k, we 

have m— 1 in A', so the inequality an < m — 1 is false by our choice 

of m. Thus m — 1 < an and, using (2), we have m < an + 1 < bn. 

Since an < m < bn, (1) holds. ■ 


Exercises 


4.1 For each set below that is bounded above, list three upper bounds for 
the set. 2 Otherwise write “NOT BOUNDED ABOVE” or “NBA.” 


(a) [0,1] 

(c) {2,7} 

(e) {L : n £ N} 

(g) [0,1] U [2,3] 

(i) rc = 1 [-i,i + i] 

(k) {n + - ^ :n£ff} 

(m) {r £ Q : r 2 < 4} 

(o) {x £ R : x < 0} 

(q) {0,1,2,4,8,16} 

(s) {- : n £ N and n is prime} 
(u) {x 2 : x £ R} 

(w) {sin(^f) : n £ N} 


(b) (0,1) 

(d) { 7 r,e} 

(f) {0} 

(h) U~ =1 [2n,2n + 1] 

0) {1 - : n £ N} 

(1) {r £ Q : r < 2} 

(n) {r £ Q : r 2 < 2} 
(P) {l,f,7r 2 ,10} 

(r) n^i-J.i + i) 
(t) {x £ M : x 3 < 8} 
(v) {cos(^f) : n £ N} 


4.2 Repeat Exercise 4.1 for lower bounds. 

4.3 For each set in Exercise 4.1, give its supremum if it has one. Otherwise 
write “NO sup.” 


2 


An integer p > 2 is a prime provided the only positive factors of p are 1 and p. 
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4.4 Repeat Exercise 4.3 for infima [plural of infimum]. 

4.5 Let S' be a nonempty subset of R that is bounded above. Prove if 
sup S belongs to S, then sup S = maxS. Hint : Your proof should be 
very short. 

4.6 Let S be a nonempty bounded subset of M. 

(a) Prove inf S < supS. Hint: This is almost obvious; your proof 
should be short. 

(b) What can you say about S if inf S = sup S? 

4.7 Let S and T be nonempty bounded subsets of M. 

(a) Prove if S C T, then inf T < inf S < supS < supT. 

(b) Prove sup(SUT) = maxjsupS,supT}. Note: In part (b), do not 
assume S CT. 

4.8 Let S and T be nonempty subsets of M with the following property: 
s < t for all s £ S and t £ T. 

(a) Observe S is bounded above and T is bounded below. 

(b) Prove sup S < inf T. 

(c) Give an example of such sets S and T where S 0 T is nonempty. 

(d) Give an example of sets S and T where sup S = inf T and S(IT 
is the empty set. 

4.9 Complete the proof that inf S = — sup(— S) in Corollary 4.5 by 
proving (1) and (2). 

4.10 Prove that if a > 0, then there exists n G N such that - < a < n. 

1 n 

4.11 Consider a, b € R where a < b. Use Denseness of Q 4.7 to show there 
are infinitely many rationals between a and b. 

4.12 Let I be the set of real numbers that are not rational; elements of I 
are called irrational numbers. Prove if a < b, then there exists x £ I 
such that a < x < b. Hint: First show {r + \[2 : r £ Q} C I. 

4.13 Prove the following are equivalent for real numbers a, b, c. [ Equivalent 
means that either all the properties hold or none of the properties 
hold.] 

(i) \a- b\ < c, 

(ii) 6 — c < a < b + c, 
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(iii) a £ (b — c, b + c). 

Hint : Use Exercise 3.7(b). 

4.14 Let A and B be nonempty bounded subsets of R, and let A + B be 
the set of all sums a + b where a £ A and b £ B. 

(a) Prove sup(T+i?) = sup T+sup B. Hint: To show sup A+sup B < 
sup(T + B), show that for each b £ B, sup(T + B) — b is an 
upper bound for A, hence sup A < sup(7l + B) — b. Then show 
sup(T + B) — sup A is an upper bound for B. 

(b) Prove inf (A + B) = inf A + inf B. 

4.15 Let a,b £ R. Show if a < b + 4 for all n £ N, then a < b. Compare 
Exercise 3.8. 

4.16 Show sup{r £ Q : r < a} = a for each a £ R. 


§5 The Symbols +00 and — 00 

The symbols +oo and —oo are extremely useful even though they 
are not real numbers. We will often write +oo as simply oo. We will 
adjoin +oo and — oo to the set M and extend our ordering to the set 
K U {— 00 ,+ 00 }. Explicitly, we will agree that —oo < a < +oo for 
all a in RU{- 00 , 00 }. This provides the set MU{— 00 ,+ 00 } with an 
ordering that satisfies properties 01, 02 and 03 of §3. We emphasize 
we will not provide the set RU {— 00 , + 00 } with any algebraic struc¬ 
ture. We may use the symbols +00 and — 00 , but we must continue 
to remember they do not represent real numbers. Do not apply a 
theorem or exercise that is stated for real numbers to the symbols 
+00 or — 00 . 

It is convenient to use the symbols +00 and —00 to extend the 
notation established in Example 1(b) of §4 to unbounded intervals. 
For real numbers a, b £ M, we adopt the following 

[a, 00 ) = {x £ M : a < x}, (a, 00 ) = {x £ M : a < x}, 

(— 00 , b] = {x £ M : x < b}, (— 00 , b) = {x £ M : x < b}. 

We occasionally also write (— 00 , 00 ) for M. [a, 00 ) and (— 00 , 6 ] are 
called closed intervals or unbounded closed intervals , while (a, 00 ) and 
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(— 00 , 6 ) are called open intervals or unbounded open intervals. Con¬ 
sider a nonempty subset S of M. Recall that if S is bounded above, 
then sup S exists and represents a real number by the completeness 
axiom 4.4. We define 

sup S = +oo if S is not bounded above. 

Likewise, if S is bounded below, then inf S exists and represents a 
real number [Corollary 4.5]. And we define 

inf S = —oo if S is not bounded below. 

For emphasis, we recapitulate: 

Let S be any nonempty subset o/K. The symbols sup S' and inf S 
always make sense. If S is bounded above, then sup S is a real num¬ 
ber; otherwise supS = +oo. If S is bounded below, then inf S is a real 
number; otherwise inf S = —oo. Moreover, we have inf S < supS. 

Example 1 

For nonempty bounded subsets A and B of M, Exercise 4.14 asserts 

sup(A+B) = sup A + supB and inf(A + B) = inf A+inf B. (1) 

We verify the first equality is true even if A or B is unbounded, and 
Exercise 5.7 asks you to do the same for the second equality. 

Consider x £ A + B, so that x = a + 6 for some a € A and 6 S B. 
Then x = a + 6 < sup A + sup B. Since x is any element in A + B, 
sup A + supB is an upper bound for A + B; hence sup (A + B) < 
sup A + sup B. It remains to show sup(A + B) > sup A + sup B. 

Since the sets here are nonempty, the suprema here are not equal 
to —oo, so we’re not in danger of encountering the undefined sum 
—oo + oo. If sup A + sup B = +oo, then at least one of the suprema, 
say supB, equals +oo. Select some ao in A. Then sup(A + B) > 
sup(ao + B) = ao + supB = +oo, so (1) holds in this case. Otherwise 
sup A + supB is finite. Consider e > 0. Then there exists a € A and 
6 6 B, so that a > sup A — | and 6 > sup B — §. Then a + b E A + B 
and so sup(A + B) > a + 6 > sup A + supB — e. Since e > 0 is 
arbitrary, we conclude sup(A + B) > sup A + sup B. □ 

The exercises for this section clear up some loose ends. Most of 
them extend results in §4 to sets that are not necessarily bounded. 
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Exercises 


5.1 Write the following sets in interval notation: 


(c) {x 2 : x £ R} 


(a) {x £ R. : x < 0} 


(b) {x £ M : x 3 < 8 } 
(d) {i£l:i 2 < 8 } 


5.2 Give the infimum and suprenrum of each set listed in Exercise 5.1. 

5.3 Give the infimum and supremum of each unbounded set listed in 
Exercise 4.1. 

5.4 Let S' be a nonempty subset of M, and let —S = {—s : s £ S}. Prove 
inf S = — sup(—S). Hint: For the case —oo < inf S, simply state that 
this was proved in Exercise 4.9. 

5.5 Prove inf S < supS for every nonempty subset of M. Compare 
Exercise 4.6(a). 

5.6 Let S and T be nonempty subsets of R. such that S C T. Prove inf T < 
inf S < supS < supT. Compare Exercise 4.7(a). 

5.7 Finish Example 1 by verifying the equality involving infimums. 


§6 * A Development of M 

There are several ways to give a careful development of M based on Q. 
We will briefly discuss one of them and give suggestions for further 
reading on this topic. [See the remarks about enrichment sections in 
the preface.] 

To motivate our development we begin by observing 


a = sup{r £ Q : r < a} for each a£l; 


see Exercise 4.16. Note the intimate relationship: a < b if and only 
if {r £ Q : r < a} C {r £ Q : r < b} and, moreover, a = b if and 
only if {r £ Q : r < a} = {r £ Q : r < b}. Subsets a of Q having the 
form {r £ Q : r < a} satisfy these properties: 

(i) a ^ Q and a is not empty, 

(ii) If r £ a, s £ Q and s < r, then s £ a, 

(iii) a contains no largest rational. 
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Moreover, every subset a of Q that satisfies (i)-(iii) has the form 
{r € Q : r < a} for some o£l; in fact, a = sup a. Subsets a of Q 
satisfying (i)-(iii) are called Dedekind cuts. 

The remarks in the last paragraph relating real numbers and 
Dedekind cuts are based on our knowledge of R, including the com¬ 
pleteness axiom. But they can also motivate a development of R 
based solely on Q. In such a development we make no a priori as¬ 
sumptions about R. We assume only that we have the ordered field 
Q and that Q satisfies the Archimedean property 4.6. A Dedekind 
cut is a subset a of Q satisfying (i)-(iii). The set R of real numbers 
is defined as the space of all Dedekind cuts. Thus elements of R are 
defined as certain subsets of Q. The rational numbers are identified 
with certain Dedekind cuts in the natural way: each rational s cor¬ 
responds to the Dedekind cut s* = {r E Q : r < s}. In this way 
Q is regarded as a subset of R, that is, Q is identified with the set 
Q* = (s* : s € Q}. 

The set R defined in the last paragraph is given an order structure 
as follows: if a and ft are Dedekind cuts, then we define a < (3 to 
signify a C f3. Properties 01, 02 and 03 in §3 hold for this ordering. 
Addition is defined in M as follows: if a and /3 are Dedekind cuts, 
then 

a + f3 = {n + r -2 : r\ € a and r 2 € /?}. 

It turns out that a + fi is a Dedekind cut [hence in M] and this defi¬ 
nition of addition satisfies properties A1 A4 in §3. Multiplication of 
Dedekind cuts is a tedious business and has to be defined first for 
Dedekind cuts >0*. For a naive attempt, see Exercise 6.4. After the 
product of Dedekind cuts has been defined, the remaining proper¬ 
ties of an ordered field can be verified for R. The ordered field R 
constructed in this manner from Q is complete: the completeness 
property in 4.4 can be proved rather than taken as an axiom. 

The real numbers are developed from Cauchy sequences in Q 
in [31, §5]. A thorough development of R based on Peano’s axioms 
is given in [39]. 
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Exercises 

6.1 Consider s,t £ Q. Show 

(a) s <t if and only if s* C f ; 

(b) s = t if and only if s* = t*\ 

(c) (s + 1)* = s* + t*. Note that s* + t* is a sum of Dedekind cuts. 

6.2 Show that if a and /3 are Dedekind cuts, then so is a + (3 = {ri + r 2 : 

ri € a and r 2 € (3}. 

6.3 (a) Show a + 0* = a for all Dedekind cuts a. 

(b) We claimed, without proof, that addition of Dedekind cuts satis¬ 
fies property A4. Thus if a is a Dedekind cut, there is a Dedekind 
cut —a such that a + (— a ) = 0*. How would you define —a? 

6.4 Let a and /3 be Dedekind cuts and define the “product”: a-/3 = {7’ir2 : 

ri £ a and r 2 G /3}. 

(a) Calculate some “products” of Dedekind cuts using the Dedekind 
cuts 0*, 1* and (—1)*. 

(b) Discuss why this definition of “product” is totally unsatisfactory 
for defining multiplication in R. 

6.5 (a) Show {r £ Q : r 3 < 2} is a Dedekind cut, but {r £ Q : r 2 < 2} is 

not a Dedekind cut. 

(b) Does the Dedekind cut {r £ Q : r 3 < 2} correspond to a rational 
number in R? 

(c) Show 0* U {r £ Q : r > 0 and r 2 < 2} is a Dedekind cut. Does it 
correspond to a rational number in R? 
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CHAPTER 


§7 Limits of Sequences 

A sequence is a function whose domain is a set of the form {n E Z : 
n > m}; m is usually 1 or 0. Thus a sequence is a function that 
has a specified value for each integer n > m. It is customary to de¬ 
note a sequence by a letter such as s and to denote its value at n 
as s n rather than s(n). It is often convenient to write the sequence 
as (s n )™ =m or (s m , s m+1 ,s m+2 , ■ ■ ■)■ If m = 1 we may write (s n )neN 
or of course (si, s 2 , S 3 ,.. .). Sometimes we will write (s n ) when the 
domain is understood or when the results under discussion do not 
depend on the specific value of m. In this chapter, we will be inter¬ 
ested in sequences whose range values are real numbers, i.e., each s n 
represents a real number. 

Example 1 

(a) Consider the sequence (s n )neN where s n = This is the 

sequence Formally, of course, this is the 

function with domain N whose value at each n is The set 

n z 

of values is {1, ..}. 


K.A. Ross, Elementary Analysis: The Theory of Calculus, 

Undergraduate Texts in Mathematics, DOI 10.1007/978-1-4614-6271-2_2, 
© Springer Science+Business Media New York 2013 
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(b) Consider the sequence given by a n = (—l ) 71 for n > 0, i.e., 
(a n )£T 0 where a n = (— l) n . Note that the first term of the se¬ 
quence is ao = 1 and the sequence is ( 1 , — 1 , 1 , — 1 . 1 , — 1 , 1 ,.. .). 
Formally, this is a function whose domain is {0,1,2,...} and 
whose set of values is {— 1 , li¬ 
lt is important to distinguish between a sequence and its 

set of values, since the validity of many results in this book 
depends on whether we are working with a sequence or a set. 
We will always use parentheses ( ) to signify a sequence and 
braces { } to signify a set. The sequence given by a n = (—1)™ 
has an infinite number of terms even though their values are 
repeated over and over. On the other hand, the set {(— l) n : 
n = 0,1,2 ,...} is exactly the set {— 1 , 1 } consisting of two 
numbers. 

(c) Consider the sequence cos( r ^ E ), n G N. The first term of this 
sequence is cos(|) = cos60° = b and the sequence looks like 


(d) 


(l _1 _i _1 1 i I _I _i _I I i I _I _i ) 

The set of values is {cos( z | L ) : n 6 N} = —1,1}. 

If a n = y/n, n 6 N, the sequence is ( 1 , y/2, v^3, {/4, • • •)• If we 
approximate values to four decimal places, the sequence looks 
like 


(1,1.4142,1.4422,1.4142,1.3797,1.3480,1.3205,1.2968,...). 

It turns out that aioo is approximately 1.0471 and apooo is 
approximately 1.0069. 

(e) Consider the sequence b n = (1 + } ) n , n E N. This is the se¬ 
quence ( 2 , (|) 2 , (|) 3 , (|) 4 j - - .)• If we approximate the values to 
four decimal places, we obtain 

(2, 2.25, 2.3704, 2.4414, 2.4883, 2.5216, 2.5465, 2.5658,...). 

Also b ioo is approximately 2.7048 and 61,000 is approximately 
2.7169. ’ □ 


The “limit” of a sequence (s n ) is a real number that the values 
s n are close to for large values of n. For instance, the values of the 
sequence in Example 1(a) are close to 0 for large n and the values 
of the sequence in Example 1(d) appear to be close to 1 for large n. 
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The sequence (a n ) given by a n = (—l)™ requires some thought. We 
might say 1 is a limit because in fact a n = 1 for the large values of n 
that are even. On the other hand, a n = — 1 [which is quite a distance 
from 1] for other large values of n. We need a precise definition in 
order to decide whether 1 is a limit of a n = (—l) n . It turns out that 
our definition will require the values to be close to the limit value 
for all large n, so 1 will not be a limit of the sequence a n = (— l) n . 

7.1 Definition. 

A sequence (s n ) of real numbers is said to converge to the real number 
s provided that 

for each e > 0 there exists a number N such that 

n > N implies |s n — s| < e. (1) 

If (s n ) converges to s, we will write lim^^oo s n = s, or s n -» s. The 
number s is called the limit of the sequence (s n ). A sequence that 
does not converge to some real number is said to diverge. 

Several comments are in order. First, in view of the Archimedean 
property, the number N in Definition 7.1 can be taken to be a positive 
integer if we wish. Second, the symbol e [lower case Greek epsilon] 
in this definition represents a positive number, not some new exotic 
number. However, it is traditional in mathematics to use e and 5 
[lower case Greek delta] in situations where the interesting or chal¬ 
lenging values are the small positive values. Third, condition (1) is 
an infinite number of statements, one for each positive value of e. 
The condition states that to each e > 0 there corresponds a number 
N with a certain property, namely n > N implies |s n — s| < e. The 
value N depends on the value e, and normally N will have to be 
large if e is small. We illustrate these remarks in the next example. 


Example 2 

| 1 

Consider the sequence s n = . If we write s n as and note 

71 

- and - are very small for large n, it seems reasonable to conclude 
lims n = |. In fact, this reasoning will be completely valid after we 
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have the limit theorems in §9: 


lim s n = lim 


3 + 4 



lim 3 + lim(i) _ 3 + 0 _ 3 

lim 7 — 4 lim(4) 7-4-0 7 


However, for now we are interested in analyzing exactly what we 
mean by lim s n = |. By Definition 7.1 , lim s n = | means 


for each 


e > 0 
n > N 


there exists a number 


implies 


3n+l 


7n—4 


iV 

< e. 


such that 


(1) 


As e varies, N varies. In Example 2 of the next section we will show 
that, for this particular sequence, N can be taken to be 3rr + f- 
Using this observation, we find that for e equal to 1, 0.1, 0.01, 0.001, 
and 0.000001, respectively, N can be taken to be approximately 0.96, 
4.45, 39.35, 388.33, and 387,755.67, respectively. Since we are inter¬ 
ested only in integer values of n, we may as well drop the fractional 


part of N. Then we see five of 
by ( 1 ) are: 


n > 0 

implies 

n > 4 

implies 

n > 39 

implies 

n > 388 

implies 

n > 387,755 

implies 


infinitely many statements given 


3n + 1 

3 

< 

i; 

(2) 

7n — 4 

7 

3n + 1 

3 

< 

0 . 1 ; 

(3) 

7n — 4 

7 

3n + 1 

3 

< 

0 . 01 ; 

(4) 

7n — 4 

7 

3n + 1 

3 

< 

0 . 001 ; 

(5) 

7n — 4 

7 

3n + 1 

3 

< 

0 . 000001 . 

( 6 ) 

7n — 4 

7 


Table 7.1 partially confirms assertions (2) through ( 6 ). We could go 
on and on with these numerical illustrations, but it should be clear 
we need a more theoretical approach if we are going to prove results 
about limits. □ 


Example 3 

We return to the examples in Example 1. 
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TABLE 7.1 


n 

„ _ 3n+l 

a n 7n_4 

is approximately 

K -1| 

is approximately 

2 

0.7000 

0.2714 

3 

0.5882 

0.1597 

4 

0.5417 

0.1131 

5 

0.5161 

0.0876 

6 

0.5000 

0.0714 

40 

0.4384 

0.0098 

400 

0.4295 

0.0010 


(a) lim \ = 0. This will be proved in Example 1 of the next 
section. 

(b) The sequence (a n ) where a n = (— l) n does not converge. Thus 
the expression “limo n ” is meaningless in this case. We will 
discuss this example again in Example 4 of the next section. 

(c) The sequence cos( r | I ) does not converge. See Exercise 8.7. 

(d) The sequence n l ^ n appears to converge to 1. We will prove 
limn 1//n = 1 in Theorem 9.7(c) on page 48. 

(e) The sequence ( b n ) where b n = (l + -) n converges to the number 

e that should be familiar from calculus. The limit lim 6 n and 
the number e will be discussed further in Example 6 in §16 and 
in §37. Recall e is approximately 2.7182818. □ 


We conclude this section by showing that limits are unique. That 
is, if lims n = s and lims n = t, then we must have s = t. In short, 
the values s n cannot be getting arbitrarily close to different values 
for large n. To prove this, consider e > 0. By the definition of limit 
there exists N\ so that 


n > N\ implies 


e 

Sn ~ S\ < ~ 


and there exists N 2 so that 


n > IV 2 implies 


s n ~ t\ < 


e 

2 ' 


For n > max{iVi, IV 2 }, the Triangle Inequality 3.7 shows 

|s — t\ = |(s — s n ) + (s n - t) | < |s - s n | + |s n - t\ < - + - = e- 
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This shows |s — t\ < e for all e > 0. It follows that |s — t\ = 0; hence 
s = t. 


Exercises 

7.1 Write out the first five terms of the following sequences. 

( a ) s n = 3iwr ( b ) = & 

(C ) Cn =£ (d)sin(^) 

7.2 For each sequence in Exercise 7.1, determine whether it converges. If 
it converges, give its limit. No proofs are required. 

7.3 For each sequence below, determine whether it converges and, if it 


converges, give its limit 

. No proofs are 

required. 

( a ) 

n — - JL - 

Un ~ n+1 

(b) 

h — ™ 2 +3 

u n — n 2_ 3 

(c) 

Cn = 2~ n 

(d) 

tn = 1 + 1 

(e) 

x n = 73 + (-l) n 

(f) 

Sn = (2 y/ n 

(g) 

Vn = n\ 

(h) 

d n = (-1 ) n n 

(i) 

(-1)” 

n 

(j) 

7n 3 +8n 

2n 3 —3 

(k) 

9n 2 — 18 

6n+18 

(1) 

sin(^) 

(in) 

sin(n7r) 

(n) 

sin(^ft) 

(°) 

- sin n 

n 

(P) 

2" +1 +5 

2 n —7 

(q) 

3 n 

n! 

(r) 

(1 + f) 2 

(s) 

4n 2 +3 

3n 2 — 2 

(t) 

6n+4 

9ra 2 +7 


7.4 Give examples of 

(a) A sequence (x n ) of irrational numbers having a limit limx n 
that is a rational number. 

(b) A sequence (r n ) of rational numbers having a limit \imr n that 
is an irrational number. 

7.5 Determine the following limits. No proofs are required, but show any 
relevant algebra. 

(a) lim s n where s n = \/n 2 + 1 — n, 

(b) lim (y/n 2 + n— n), 

(c) lim(v , 4?r 2 + n — 2n). 

Hint for (a): First show s n = , , 1 , , . 

J y Vn J +l+n 
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§8 A Discussion about Proofs 

In this section we give several examples of proofs using the definition 
of the limit of a sequence. With a little study and practice, students 
should be able to do proofs of this sort themselves. We will some¬ 
times refer to a proof as a formal proof to emphasize it is a rigorous 
mathematical proof. 


Example 1 

Prove lim \ = 0. 

Discussion. Our task is to consider an arbitrary e > 0 and show 
there exists a number N [which will depend on e] such that n > N 
implies |4j — 0| < e. So we expect our formal proof to begin with 
“Let e > 0” and to end with something like “Hence n > N implies 
| A - 0| < e.” In between the proof should specify an N and then 
verify N has the desired property, namely n > N does indeed imply 

I i? _ °l < e - 

As is often the case with trigonometric identities, we will initially 
work backward from our desired conclusion, but in the formal proof 
we will have to be sure our steps are reversible. In the present exam¬ 
ple, we want | Aj — 0| < e and we want to know how big n must be. 
So we will operate on this inequality algebraically and try to “solve” 
for n. Thus we want ^ < e. By multiplying both sides by n 2 and 
dividing both sides by e, we find we want -- < n 2 or ^ < n. If our 
steps are reversible, we see n > -4= implies 1-^ — 0| < e. This suggests 

V € n 

we put N = A=. 


Formal Proof 

Let e > 0. Let N = -A. Then n > N implies n > 
n 2 > - and hence e > Thus n > N implies | 
proves lim ^ = 0. 


l 


which 
- 0 | < 


implies 
e. This 


Example 2 

Prove lim = f 
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Discussion. For each e > 0, we need to to decide how big n must 
be to guarantee — || < e. Thus we want 


21?r + 7 — 21n + 12 


7(4n - 4) 


< e or 


19 


7(7n - 4) 


< e. 


Since 7n — 4 > 0, we can drop the absolute value and manipulate 
the inequality further to “solve” for n: 

19 19 19 4 

— < 7n — 4 or-h 4 < 7n or- 1 — < n. 

7e 7e 49e 7 

Our steps are reversible, so we will put N = ^ Incidentally, we 
could have chosen N to be any number larger than ^ + |. 


Formal Proof 


Let e > 0 and let N = 4557 + 7 - 
hence 7n > 

I 3n+l 
I 7n—4 


Then n > N implies n > 3557 + f, 


4, hence 7n — 4 > hence 


19 


- f | < e. This proves lim = 3 . 


7(7n—4) 


< e, and hence 


Example 3 

Prove lim = 4 . 

72+— D 

Discussion. For each e > 0, we need to determine how large n 
has to be to imply 


4n 3 + 3n 
re 3 — 6 



< e 


or 


3n + 24 
n 3 — 6 


By considering n > 1, we may drop the absolute values; thus we need 
to find how big n must be to give ^ 3 ^ < e. This time it would be 
very difficult to “solve” for or isolate n. Recall we need to find some 
N such that n > N implies < e, but we do not need to find 

the least such N. So we will simplify matters by making estimates. 
The idea is that 3n 3 +2 . 4 is bounded by some constant times -t- = \ 
for sufficiently large n. To find such a bound we will find an upper 
bound for the numerator and a lower bound for the denominator. 
For example, since 3n + 24 < 27n, it suffices for us to get < e. 
To make the denominator smaller and yet a constant multiple of n 3 , 
we note n 3 — 6 > \ provided n is sufficiently large; in fact, all we 
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need is ^ > 6 or n 3 > 12 or n > 2 . So it suffices to get 
< e or n > yf^, provided n > 2 . 


< e or 


Formal Proof _ 

Let e > 0 and let N = max{2, y Then n > N implies n > 

hence H < e, hence < e. Since n > 2, we have ^ < n 3 — 6 and 
also 27n >3n + 24. Thus n > N implies 
3 n + 24 27 n _ 54 

n 3 — 6 — ^n 3 n 2 ^ ’ 


and hence 


4ra 3 + 3 n 
n 3 — 6 



< e, 


as desired. 


Example 3 illustrates direct proofs of even rather simple limits 
can get complicated. With the limit theorems of §9 we would just 
write 


4n 3 + 3n 

= lim 

"4+ A' 

lim 4+ 3 • lim(4j) 

n 3 — 6 

50 l°e 

1 

T—1 

_1 

lim 1 — 6 • lim (^3 ) 


Example 4 

Show that the sequence a n = (— l) n does not converge. 

Discussion. We will assume lim(—l) n = a and obtain a contra¬ 
diction. No matter what a is, either 1 or —1 will have distance at 
least 1 from a. Thus the inequality |(— l) n — a| < 1 will not hold for 
all large n. 

Formal Proof 

Assume lim(—l) n = a for some a£l. Letting e = 1 in the definition 
of the limit, we see that there exists N such that 

n>N implies |(— l) n — a\ < 1. 

By considering both an even and an odd n > N, we see that 

11 — a\ <1 and I — 1 — a\ < 1 . 
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Now by the Triangle Inequality 3.7 

2 = |1 — (—1)| = |1 — a + a— (—1)| < |1 — a| + |a — (—1)| <1 + 1 = 2. 

This absurdity shows our assumption lim(—l) n = a must be wrong, 
so the sequence (— l) n does not converge. ■ 

Example 5 

Let (s n ) be a sequence of nonnegative real numbers and suppose 
s = liiri s n . Note s > 0; see Exercise 8.9(a). Prove limy's^ = y/s. 

Discussion. We need to consider e > 0 and show there exists N 
such that 


n > N implies | y/s/ — y/s\ < e. 


This time we cannot expect to obtain N explicitly in terms of e 
because of the general nature of the problem. But we can hope to 
show such N exists. The trick here is to violate our training in algebra 
and “irrationalize the denominator”: 


y/ Sn 


V~s = 


(y/Sn — y/s)(y/Sn + y/s) 
y/Sn + y/~S 


Sn — S 
y/~Sn + y/~S 


Since s n ^ s we will be able to make the numerator small [for large 
n}. Unfortunately, if s = 0 the denominator will also be small. So we 
consider two cases. If s > 0, the denominator is bounded below by 
y/s and our trick will work: 


\y/~Sn ~ y/s\ < 

V s 

so we will select N so that |s n — s\ < yfse for n > N. Note that N 
exists, since we can apply the definition of limit to y/se just as well 
as to e. For s = 0, it can be shown directly that lims n = 0 implies 
lim y/s^ = 0; the trick of “irrationalizing the denominator” is not 
needed in this case. 


Formal Proof 

Case I: s > 0. Let e > 0. Since lims n = s, there exists N such that 
n > N implies |s n — s| < y/se. 
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Now n > N implies 


~ >/i| 


|Sn — s| < |Sn ~ s| y/s€ 

y/Sn + y/s y/s y/~S 


Case II: s = 0. This case is left to Exercise 8.3. 


Example 6 

Let (s n ) be a convergent sequence of real numbers such that s n ^ 0 
for all n G N and lims n = s 7 ^ 0. Prove inf{|s n | : n 6 N} > 0. 

Discussion. The idea is that “most” of the terms s n are close to s 
and hence not close to 0. More explicitly, “most” of the terms s n are 
within ||s| of s, hence most s n satisfy |s n | > ||s|. This seems clear 
from Fig. 8.1, but a formal proof will use the triangle inequality. 


Formal Proof 

Let e = i|s| > 0. Since liiri s n = s, there exists N in N so that 


Now 


n > N implies |s n — s| < 


n > N implies |s n | > —, 


since otherwise the triangle inequality would imply 


— I s ~ s n + s n | < Is — s n | + |s n | < ——I—— — Is 


2 2 


which is absurd. If we set 


( 1 ) 


m = min <J —, |si|, |s 2 |,... , |sjv| \ , 


mosts„ here 
A 


-j>0 


mosti„ here 


-s<0 


FIGURE 8.1 
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then we clearly have m > 0 and |s n | > m for all n £ N in view of (1). 
Thus infUs^l : n 6 N} > m > 0, as desired. ■ 

Formal proofs are required in the following exercises. 


Exercises 

8.1 Prove the following: 

(a) lim hiT- = 0 (b) lirn ^ = 0 

( c ) lim & = I ( d ) lim iSI = 0 

8.2 Determine the limits of the following sequences, and then prove your 
claims. 

(a) a n = n J^_ 1 

(' r \ „ _ 4n+3 

tw <« — 7n—5 

(e) s„ = i sin n 

8.3 Let (s n ) be a sequence of nonnegative real numbers, and suppose 
lims n = 0. Prove limy^ = 0. This will complete the proof for 
Example 5. 

8.4 Let (t„) be a bounded sequence, i.e., there exists M such that \t n \ < M 
for all n, and let (s n ) be a sequence such that limsn = 0. Prove 
lim(s n £ n ) = 0 . 

8.5 ★ ' 

(a) Consider three sequences (a n ), (b n ) and (s n ) such that a n < 
s n < b n for all n and lima n = lim 6 n = s. Prove lirns^ = s. 
This is called the “squeeze lemma.” 

(b) Suppose (s„) and (t n ) are sequences such that |s n | < t n for all 
n and limt„ = 0. Prove lims^ = 0. 

8.6 Let (s„) be a sequence in K. 

(a) Prove lims,! = 0 if and only if lim |s n | =0. 

(b) Observe that if s n = (—1)", then lim |s n | exists, but lims„ does 
not exist. 

8.7 Show the following sequences do not converge. 

(a) cos( 2 f) (b) s n = (-1 ) n n 

(c) sin(^) 


(b) 

(d) 


bn — 


7n—19 
3n+7 
J _ 2n+4 
— 5n+2 


1 This exercise is referred to in several places. 
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8.8 Prove the following [see Exercise 7.5]: 

(a) lim[\At 2 + 1 — n] = 0 (b) lim[\/n 2 + n — n] = | 

(c) lim[\/4n 2 + n — 2 n] = \ 

8.9 -Ar 2 Let (s„) be a sequence that converges. 

(a) Show that if s n > a for all but finitely many n, then lim s n > a. 

(b) Show that if s n < b for all but Enitely many n, then lims n < b. 

(c) Conclude that if all but finitely many s n belong to [a, 6 ], then 
lims n belongs to [a, b\. 

8.10 Let (s n ) be a convergent sequence, and suppose lims„ > a. Prove 
there exists a number N such that n > N implies s n > a. 


§9 Limit Theorems for Sequences 

In this section we prove some basic results that are probably al¬ 
ready familiar to the reader. First we prove convergent sequences 
are bounded. A sequence (s n ) of real numbers is said to be bounded 
if the set (s n : n G N} is a bounded set, i.e., if there exists a constant 
M such that |s n | < M for all n. 

9.1 Theorem. 

Convergent sequences are bounded. 

Proof 

Let (s n ) be a convergent sequence, and let s = lim s n . Applying 
Definition 7.1 with e = 1 we obtain N in N so that 

n > N implies |s n — s| < 1. 

From the triangle inequality we see n > N implies |s n | < |s| + 1. 
Define M = max{|s| + 1, |si|, |« 2 1, ■ ■ ■, |sjv|}- Then we have |s n | < M 
for all n £ N, so (s n ) is a bounded sequence. ■ 

In the proof of Theorem 9.1 we only needed to use property 7.1(1) 
for a single value of e. Our choice of e = 1 was quite arbitrary. 


2 This exercise is referred to in several places. 
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9.2 Theorem. 

If the sequence (s n ) converges to s and k is in M, then the sequence 
(. ks n ) converges to ks. That is, lim(fcs n ) = k ■ lims n . 

Proof 

We assume k ^ 0, since this result is trivial for k = 0. Let e > 0 and 
note we need to show | ks n — ks\ < e for large n. Since lims n = s, 
there exists N such that 

n > N implies |s n — s| < —. 

\k\ 

Then 

n > N implies \ks n — ks | < e. _ 


9.3 Theorem. 

If (s n ) converges to s and (t n ) converges to t, then ( s n +t n ) converges 
to s + t. That is, 

lim(s n + t n ) = lim s n + lim t n . 

Proof 

Let e > 0; we need to show 

|s n + t n — (s + f)| < e for large n. 

We note \s n + t n — (s + t)\ < |s n — s| + \t n — 1 1. Since lim s n = s, there 
exists N\ such that 

n> N\ implies |s n — s\ < 

Likewise, there exists N 2 such that 

n > N 2 implies \t n — t\ < -. 

Let N = max{iVi, AT 2 }. Then clearly 

n>N implies |s 7l +f ri -(s+t)| < |s n -s|+|t n -t|<|+-= e. 


9.4 Theorem. 

If (s n ) converges to s and (t n ) converges to t, then ( s n t n ) converges 
to st. That is, 


lim (s n t n ) = (lim s n )(lim t n ). 



§9. Limit Theorems for Sequences /^J 


Discussion. The trick here is to look at the inequality 


l^n^n — l^n^n &r T S n t 

— I^n^n | T | S n t St\ 


«n| ' | t n - i| + \t\ • |Sn ~ S 


For large n, \t n —t\ and |s n —s| are small and |f | is, of course, constant. 
Fortunately, Theorem 9.1 shows |s n | is bounded, so we will be able 
to show | s n t n — s n t | is small. 


Proof 

Let e > 0. By Theorem 9.1 there is a constant M > 0 such that 
|s n | < M for all n. Since limt n = t there exists N\ such that 

n> N\ implies | t n - t\ < 

Also, since lim s n = s there exists N 2 such that 


n > N 2 implies |s n — s\ < 


2 ( 1 * 1 + 1 ) 

[We used instead of At, because t could be 0.] Now if N = 

maxjlVi, IV 2 }, then n> N implies 


| S n t n — St | < |s n | • | t n — t\ + 


s n s 
e 


- M ' 2 M + ^ ' 2(|*| + 1) 


e e 

< 2 + 2 = € - 


To handle quotients of sequences, we first deal with reciprocals. 


9.5 Lemma. 

If (sn) converges to s, if s n 7 ^ 0 for all n, and if s ^ 0, then (1 /s n ) 
converges to 1/s. 


Discussion. We begin by considering the equality 


1 

1 


s s n 

Sn 

S 


s n s 


For large n, the numerator is small. The only possible difficulty would 
be if the denominator were also small for large n. This difficulty was 
solved in Example 6 of §8 where we proved m=inf{|s n | : n£N}>0. 
Thus 


1 

Sn 


1 

S 


s — s n 
m|s| 
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and it is clear how our proof should proceed. 

Proof 

Let e > 0. By Example 6 of §8, there exists m > 0 such that |s n | > m 
for all n. Since lirn s n = s there exists N such that 

n > N implies |s — s n | < e • m|s|. 

Then n > N implies 

s — s n I I s — s n I 

--r 1 < J — rr - < e- 

|s n s| m|s| H 


1 1 

s n s 


9.6 Theorem. 

Suppose (s n ) converges to s and (t n ) converges to t. If s ^ 0 and 
s n ~f~ 0 for all n, then ( t n /s n ) converges to t/s. 

Proof 

By Lemma 9.5, the sequence (1 /s n ) converges to 1/s, so 

t n 1 1 t 

lim — = Inn — • t n = — • t = - 
Sn Sn S S 

by Theorem 9.4. ■ 

The preceding limit theorems and a few standard examples allow 
one to easily calculate many limits. 

9.7 Theorem (Basic Examples). 

(a) lim^oo(^) = 0 for p> 0 . 

(b) lim^oo a n = 0 if |a| < 1 . 

(c) lim(n 1 / n ) = 1 . 

(d) lim n _> 0 O (a 1 / n ) = 1 for a > 0 . □ 

Proof 

(a) Let e > 0 and let N = ■ Then n > N implies n p > - 

and hence e > Since ^ > 0, this shows n > N implies 
| ^ — 0| < e. [The meaning of n p when p is not an integer will 
be discussed in §37.] 

(b) We may suppose a / 0, because lim, woo a n = 0 is obvious for 
a = 0. Since |a| < 1. we can write |a| = where b > 0. By 
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the binomial theorem [Exercise 1.12], (1 + b) n > 1 + nb > nb, 
so 


a n — 0 | = |a n 


1 1 

(1 + b) n < nb' 


Now consider e > 0 and let N = +. Then n > N implies n > -h 
and hence ir/" - ()| < < e. 

(c) Let s n = ( n}! n ) — 1 and note s n > 0 for all n. By Theorem 9.3 
it suffices to show lim s n = 0. Since 1 + s n = (re 1//n ), we have 
n = (1 + s n ) n . For n > 2 we use the binomial expansion of 
(1 + s n ) n to conclude 


n = (1 + s n ) n > 1 + ns n + ^re(re - l)s 2 > ^n(n - l)s 2 . 

Thus n > \n(n — 1 )s 2 , so s 2 < ~4[. Consequently, we have 

s n < J f° r re > 2. A standard argument now shows 
lims n = 0; see Exercise 9.7. 

(d) First suppose a > 1. Then for re > a we have 1 < a 1//n < re 1 /”. 
Since limre 1//n = 1 , it follows easily that lim(a 1 / n ) = 1; compare 
Exercise 8.5(a). Suppose 0 < a < 1. Then ^ > 1, so lim^) 1 /™ = 
1 from above. Lemma 9.5 now shows lim(a 1 / n ) = 1. ■ 


Example 1 

Prove lims n = where 

re 3 + 6 re 2 + 7 
Sn 4?r 3 + 3re — 4 


Solution 

We have 


Sr). — 


I i 6 , _7_ 

' n ' n 3 

4 + 4-4' 


By Theorem 9.7(a) we have lim 4 = 0 and lim dj 
Theorems 9.3 and 9.2 we have 


0. Hence by 


1 6 7 

1 H-1—5- 


re 


re d 


lirn(l) + 6 • lim 



+ 7 • lim 


1 

re 3 


lim 


= 1 . 
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Similarly, we have 


lim 


. 3 4 

4 H—7T-5- 




r 


Hence Theorem 9.6 implies lims n = 4 


= 4. 


□ 


Example 2 

Find lim n ~ 5 


n 2 +7' 


□ 


Solution 

Let = n ra a ~ 5 7 . We can write s r 
does not converge. So we write 


1 — — 

as —but then the denominator 

ra+ — 


Sn. — 


5 


1+4 

1 n" 


Now lim(+ — Jj-) = 0 by Theorems 9.7(a), 9.3 and 9.2. Likewise 
lim(l + ^r) = 1, so Theorem 9.6 implies lims n = j = 0. □ 


Example 3 


Find lim 


n 2 + 3 
n +1 ' 


□ 


Solution 

We can write as 


n + - 

n 

l + h 


or 


i + 4 

n z 

i + 4' 

n n z 


Both fractions lead to problems: either the numerator does not con¬ 
verge or else the denominator converges to 0. It turns out y4p does 

not converge and the symbol lim n n t\ is undefined, at least for the 
present; see Example 6. The reader may have the urge to use the sym¬ 
bol +oo here. Our next task is to make such use of the symbol +oo 
legitimate. For a sequence (s n ), lim -s n = +oo will signify that the 
terms s n are eventually all large. Here is the precise definition. □ 


9.8 Definition. 

For a sequence (s n ), we write lim s n = +oo provided 
for each M > 0 there is a number N such that 
n > N implies s n > M. 
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In this case we say the sequence diverges to +oo. 

Similarly, we write lirn s n = —oo provided 
for each M < 0 there is a number N such that 
n > N implies s n < M. 

Henceforth we will say (s n ) has a limit or the limit exists pro¬ 
vided (s n ) converges or diverges to +oo or diverges to —oo. In the 
definition of lim s n = +oo the challenging values of M are large pos¬ 
itive numbers: the larger M is the larger N will need to be. In the 
definition of lim s n = —oo the challenging values of M are “large” 
negative numbers like — 10 , 000 , 000 , 000 . 

Example 4 

We have limn 2 = +oo, lim(—n) = —oo, lim2 n = +oo and 
lim (y/n + 7) = Too. Of course, many sequences do not have limits 
+oo or —oo even if they are unbounded. For example, the sequences 
defined by s n = (—1 ) n n and t n = ncos 2 (^-) are unbounded, but 
they do not diverge to +oo or —oo, so the expressions lim[(— l) n n] 
and lim [n cos 2 (^)] are meaningless. Note t n = n when n is even and 
t n = 0 when n is odd. □ 

The strategy for proofs involving infinite limits is very much the 
same as for finite limits. We give some examples. 

Example 5 

Give a formal proof that + 7) = +oo. □ 

Discussion. We need to consider an arbitrary M > 0 and show 
there exists N [which will depend on M] such that 

n > N implies y/n + 7 > M. 

To see how big N must be we “solve” for n in the inequality y/n+7 > 
M. This inequality holds provided y/n > M — 7 or n > ( M — 7) 2 . 
Thus we will take N = (M — 7) 2 . 

Formal Proof 

Let M > 0 and let N = (M —7) 2 . Then n > N implies n > (M — 7) 2 , 
hence y/n > M — 7, hence y/n + 7 > M. This shows lim (y/n + 7) = 
Too. ■ 
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Example 6 

Give a formal proof that lim = Too; see Example 3. □ 


Discussion. Consider M > 0. We need to determine how large n 
must be to guarantee ^ _+ 3 > M. The idea is to bound the fraction 

^ below by some multiple of ^ = n; compare Example 3 of § 8 . 
Since n 2 + 3 > n 2 and n + 1 < 2 n, we have ^ = \n , and it 

suffices to arrange for -,n> M. 


Formal Proof 

Let M > 0 and let N = 2 M. Then n > N implies \n > M , which 
implies 


n 2 + 3 
n + 1 



1 

2 


n > M. 


Hence lim 


= Too. 


n -\-1 


The limit in Example 6 would be easier to handle if we could 
apply a limit theorem. But the limit Theorems 9.2-9 .6 do not apply. 

WARNING. Do not attempt to apply the limit Theorems 9.2-9.6 
to infinite limits. Use Theorem 9.9 or 9.10 below or Exercises 9.9- 
9.12. 


9.9 Theorem. 

Let (s n ) and ( t n ) be sequences such that lim s n = +oo and lim t-n ^ 0 
[lim t n can be finite or +oo] . Then lim s n t n = +oo. 

Discussion. Let M > 0. We need to show s n t n > M for large n. 
We have lims n = +oo, and we need to be sure the f n ’s are bounded 
away from 0 for large n. We will choose a real number m so that 
0 < m < lim t, n and observe t n > m for large n. Then all we need is 

> m for lar S e n - 

Proof 

Let M > 0. Select a real number m so that 0 < m < lim t n . Whether 
lim t n = Too or not, it is clear there exists N\ such that 


n > N\ implies t n > m; 
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see Exercise 8.10. Since lims n = +oo, there exists N 2 so that 

Ar . v M 

n > JMo implies s n > —. 

m 

Put N = in ax {TV], IV 2 }. Then n > N implies s n t n > m = M. ■ 

Example 7 

Use Theorem 9.9 to prove lim = + 00 ; see Example 6. □ 

Solution 

We observe f = s n t n where s n = n+ | and t n = It 

' n ' n 

is easy to show lims n = +00 and lim t n = 1. So by Theorem 9.9, we 
have lim s n t n = + 00 . □ 

Here is another useful theorem. 


9.10 Theorem. 

For a sequence (s n ) of positive real numbers, we have lim s n = +00 
if and only if lim(^-) = 0 . 

Proof 

Let (s n ) be a sequence of positive real numbers. We have to show 


and 


lims n = +00 implies 




0 implies lim s n = + 00 . 


(1) 

(2) 


In this case the proofs will appear very similar, but the thought 
processes will be quite different. 

To prove (1), suppose lims n = + 00 . Let e > 0 and let M = - . 
Since lims n = + 00 , there exists N such that n > N implies s n > 
M = Therefore n > N implies e > f- > 0, so 

G Sn 


n > N implies 


1 

-0 

Sn 


< e. 


That is, lim(jy-) = 0. This proves (1). 

To prove (2), we abandon the notation of the last paragraph and 
begin anew. Suppose lim(j-) = 0. Let M > 0 and let e = jj. Then 
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e > 0, so there exists N such that n > N implies I — 

Sn 

Since s n > 0, we can write 


and hence 


n > N implies 0 < — < — 
s n M 


0 | < e 


M' 


n > N implies M < s n . 


That is, liiri s n = +oo and (2) holds. 


Exercises 


9.1 Using the limit Theorems 9.2-9.7, prove the following. Justify all steps, 

(a) lim=±! = l (b)lim|^ = i 


(c) lim 


17n 5 +73n 4 —18n 2 +3 _ 17 
23ra 5 + 13n 3 23 


9.2 Suppose lima;,! = 3, limy,, 
following limits: 

(a) lim(x„ + y„) 


7 and all y n are nonzero. Determine the 

(b ) hm 


9.3 Suppose lima,, = a, lim6 n = b , and s n = Prove lim s n = 

a b 2 ^i carefully, using the limit theorems. 

9.4 Let Si = 1 and for n > 1 let s„+i = y/s n + 1. 

(a) List the first four terms of (s„). 

(b) It turns out that (s n ) converges. Assume this fact and prove 
the limit is |(1 + \/5). 

1 2 _|_2 

9.5 Let ti = 1 and t n+ 1 = -|r— for n > 1. Assume ( t n ) converges and find 
the limit. 


9.6 Let x\ = 1 and x n+ \ = 3a ;\ for n > 1. 

(a) Show if a = lima;,,, then a = | or a = 0. 

(b) Does lima;„ exist? Explain. 

(c) Discuss the apparent contradiction between parts (a) and (b). 

9.7 Complete the proof of Theorem 9.7(c), i.e., give the standard argument 
needed to show lims„ = 0 . 
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9.8 Give the following when they exist. Otherwise assert “NOT EXIST.” 

(a) limn 3 (b) lim(—n 3 ) 

(c) lim(— n) n (d) lim(l.Ol)" 

(e) limn" 

9.9 Suppose there exists No such that s n < t n for all n> No- 

(a) Prove that if lims^ = +oo, then limf„ = Too. 

(b) Prove that if limt n = —oo, then lims n = —oo. 

(c) Prove that if liins ra and limi„ exist, then lims n < limt„. 

9.10 (a) Show that if lims n = Too and k > 0, then lim(fcs„) = +oo. 

(b) Show lim s n = +oo if and only if lim(— s n ) = — oo. 

(c) Show that if lims n = Too and k < 0, then lim(fcs„) = — oo. 

9.11 (a) Show that if lims^ = Too and infjUj : n £ N} > —oo, then 

lim(s„ + t n ) = Too. 

(b) Show that if lim s n = +oo and lim£ n > — oo, then lim^n + t n ) = 
Too. 


(c) Show that if lim s n = Too and if (£„) is a bounded sequence, then 
lim(s„ T t n ) = Too. 


9.12 -jr 3 Assume all s n ^ 0 and that the limit L = lim | ^y ti | exists. 

(a) Show that if L < 1, then lims„ = 0. Hint : Select a so that 
L < a < 1 and obtain N so that |s ra +i| < a|sn| for n > N. 
Then show |s„| < oT'^IsatI for n > N. 


(b) Show that if L > 1, then lim|s„| = Too. Hint: Apply (a) to 
the sequence t n = yfo-r; see Theorem 9.10. 

I s ri | 


9.13 Show 


lim a n = 

n—> oo 


o 

l 

Too 

does not exist 


if |a| < 1 

if a = 1 

if a > 1 

if a < — 1 


9.14 Let p > 0. Use Exercise 9.12 to show 


a“ 

hm — = 

n—> oo TlP 


o 

Too 

does not exist 


if |a| < 1 
if a > 1 

if a < —1. 


Hint: For the a > 1 case, use Exercise 9.12(b). 


3 This exercise is referred to in several places. 
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9.15 Show linin^oo = 0 for all a € M. 

9.16 Use Theorems 9.9 and 9.10 or Exercises 9.9-9.15 to prove the following: 

(a) lim = +0O 

(b) lim[^ + (-1)"] = +oo 

(c) lim[£ - ^ = +°° 

9.17 Give a formal proof that limn 2 = +oo using only Definition 9.8. 

9.18 (a) Verify 1 + a + a 2 + ■ ■ • + a n = for a/1. 

(b) Find lim n _ >oc (l + a + a 2 + • • • + a n ) for |a| < 1. 

(c) Calculate lim„_ >00 (l + § + § + ^ d- h^r). 

(d) What is lim n _ >00 (l + a + o 2 + • • • + a n ) for a > 1? 

§10 Monotone Sequences and Cauchy 
Sequences 

In this section we obtain two theorems [Theorems 10.2 and 10.11] 
that will allow us to conclude certain sequences converge without 
knowing the limit in advance. These theorems are important because 
in practice the limits are not usually known in advance. 

10.1 Definition. 

A sequence (s n ) of real numbers is called an increasing sequence 
if s n < s n+ i for all n, and (s n ) is called a decreasing sequence if 
s n > Sn+i for all n. Note that if (s n ) is increasing, then s n < s m 
whenever n < m. A sequence that is increasing or decreasing 4 will 
be called a monotone sequence or a monotonic sequence. 

Example 1 

The sequences defined by a n = 1 — b n = n 3 and c n = 
(1 + y) n are increasing sequences, although this is not obvious for the 


Tn the First Edition of this book, increasing and decreasing sequences were 
referred to as “nondecreasing” and “nonincreasing” sequences, respectively. 
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sequence (c n ). The sequence d n = -^ is decreasing. The sequences 
s n = (-1)", t n = cos(^f), u n = (-1 ) n n and v n = are not 

monotonic sequences. Also x n = n 1 / n is not monotonic, as can be 
seen by examining the first four values; see Example 1(d) on page 33 
in §7. 

Of the sequences above, (a n ), (c n ), ( d n ), (s n ), ( t n ), ( v n ) and (. x n ) 
are bounded sequences. The remaining sequences, (b n ) and (u n ), are 
unbounded sequences. □ 

10.2 Theorem. 

All bounded monotone sequences converge. 

Proof 

Let (s n ) be a bounded increasing sequence. Let S denote the set 
{s n : n £ N}, and let u = sup S. Since S is bounded, u represents a 
real number. We show lirri s n = u. Let e > 0. Since u — e is not an 
upper bound for S, there exists N such that sn > u — e. Since (s n ) 
is increasing, we have sn < s n for all n > N. Of course, s n < u for 
all n, so n > N implies u — e < s n < u, which implies |s n — u\ < e. 
This shows lim s n = u. 

The proof for bounded decreasing sequences is left to 
Exercise 10.2. ■ 

Note the Completeness Axiom 4.4 is a vital ingredient in the 
proof of Theorem 10.2. 

Example 2 

Consider the sequence (s n ) defined recursively by 

s 2 i 5 

si = 5 and s n = n ~ 1 - for n > 2. (1) 

2 s n _i 

Thus S 2 = 3 and s ;i % 2.333. First, note a simple induction 
argument shows s n > 0 for all n. We will show lim n s n exists by 
showing the sequence is decreasing and bounded; see Theorem 10.2. 
In fact, we will prove the following by induction: 

VE < s n+ i < s n < 5 for n > 1. 


(2) 
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Since ^5 » 2.236, our computations show (2) holds for re < 2. For 
the induction step, assume (2) holds for some n > 2. To show s n . j _2 < 
s n+ 1 , we need 


s n +1 + 5 

2Sn+l 


< Sn+1 


or 


®n+i ~h 5 <C 2s n+1 or 5 <C 


but this holds because 
show s n+ 2 > Vs, we need 

s ' +1 + 5 > Vs 

2Sn+l 


> y/S by the assumption (2) for re. To 


or s 2 +1 + 5 > 2v / 5s n+ i 


or s 2 +1 — 2VSs n+ \+S > 0, which is true because s 2 +i~2-\/5s n +i+5 = 
(s n+ i — V5 ) 2 > 0. Thus (2) holds for re + 1 whenever (2) holds for re. 
Hence (2) holds for all re by induction. Thus s = lim^ s n exists. 

If one looks at S 4 = V ~ 2.238095 and compares with Vs ~ 
2.236068, one might suspect s = Vs. To verify this, we apply the 
limit Theorems 9.2-9.4 and the fact s = lim n to the equation 
2 • = s 2 + 5 to obtain 2s 2 = s 2 + 5. Thus s 2 = 5 and s = VS, 

since the limit is certainly not —y/S. □ 


10.3 Discussion of Decimals. 

We have not given much attention to the notion that real numbers 
are simply decimal expansions. This notion is substantially correct, 
but there are subtleties to be faced. For example, different decimal 
expansions can represent the same real number. The somewhat more 
abstract developments of the set M of real numbers discussed in §6 
turn out to be more satisfactory. 

We restrict our attention to nonnegative decimal expansions and 
nonnegative real numbers. From our point of view, every nonnegative 
decimal expansion is shorthand for the limit of a bounded increasing 
sequence of real numbers. Suppose we are given a decimal expansion 
K.did 2 (i^d 4 : • • •, where K is a nonnegative integer and each dj belongs 
to {0,1, 2, 3,4, 5, 6, 7, 8, 9}. Let 


Sn 


d\ C?2 

A + Io + Io^ + "' + 


dn 

To™’ 


(i) 


Then (s n ) is an increasing sequence of real numbers, and (s n ) is 
bounded [by K + 1, in fact]. So by Theorem 10.2, (s n ) converges to 
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a real number we traditionally write as K.d\d-zd-^d^ ■ ■ ■■ For example, 
3.3333 • • • represents 

/ 3 3 3 \ 

lim I 3 T — "I - —77 T ■ ■ ■ T- ) • 

oo y 10 10 2 10 n y 

To calculate this limit, we borrow the following fact about geometric 
series from Example 1 on page 96 in §14: 

lim a(l + r + r 2 + • • • + r n ) = —— for |r| < 1; (2) 

n—XX) 1 — T 

see also Exercise 9.18. In our case, a = 3 and r = so 3.3333- • • 

represents —T~ = -y, as expected. Similarly, 0.9999 • • • represents 
i- io 

/ 9 9 9 \ T7j 

n^oo^lO 10 2 10 n ) 1 - T 

Thus 0.9999 • • • and 1.0000 • • • are different decimal expansions that 
represent the same real number! 

The converse of the preceding discussion also holds. That is, every 
nonnegative real number x has at least one decimal expansion. This 
will be proved, along with some related results, in §16. □ 


Unbounded monotone sequences also have limits. 

10.4 Theorem. 

(i) If ( s n ) is an unbounded increasing sequence, then lim s n = 
Too. 

(ii) If (s n ) is an unbounded decreasing sequence, then lim s n = 
—oo. 

Proof 

(i) Let (s n ) be an unbounded increasing sequence. Let M > 0. 
Since the set {s n : n £ N} is unbounded and it is bounded 
below by si, it must be unbounded above. Hence for some N 
in N we have sjv > M. Clearly n > N implies s n > sjv > M , 
so lim s n = Too. 

(ii) The proof is similar and is left to Exercise 10.5. ■ 
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10.5 Corollary. 

If {sn) is a monotone sequence, then the sequence either converges, 
diverges to +oo, or diverges to —oo. Thus lims n is always meaningful 
for monotone sequences. 

Proof 

Apply Theorems 10.2 and 10.4. ■ 

Let (s n ) be a bounded sequence in K; it may or may not converge. 
It is apparent from the definition of limit in 7.1 that the limiting 
behavior of (s n ) depends only on sets of the form {s„, : n > N}. For 
example, if lims n exists, clearly it lies in the interval [un,vn] where 

un = inf{s n : n > N} and vn = sup{s n : n > IV}; 

see Exercise 8.9. As N increases, the sets (s n : n > N} get smaller, 
so we have 


u\ < U 2 < U 3 < ■ ■ ■ and v\ > V 2 > V 3 > ■ ■ ■; 

see Exercise 4.7(a). By Theorem 10.2 the limits u = lim 7 v->-oo un 
and v = limyv—>-oo vn both exist, and u < v since un < wjv for all N. 
If lirri s n exists then, as noted above, un < lirri s n < vn for all N, 
so we must have u < lims n < v. The numbers u and v are useful 
whether lim s n exists or not and are denoted lim inf s n and lim sup s n , 
respectively. 

10.6 Definition. 

Let (s n ) be a sequence in M. We define 

lim sup s n = lim sup {s n : n > N} (1) 

N^-OO 

and 

lim inf s n = lim inf {s n : n > N}. (2) 

iV—>-00 

Note that in this definition we do not restrict (s n ) to be bounded. 
However, we adopt the following conventions. If (s n ) is not bounded 
above, sup{s n : n > N } = +00 for all N and we decree lim sup s n = 
+00. Likewise, if (s n ) is not bounded below, inf{s n : n > N} = —00 
for all N and we decree lim inf s n = —00. 
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We emphasize limsup s n need not equal sup{s n : n G N}, but 
lim sup s n < sup{s n : n 6 N}. Some of the values s n may be much 
larger than lim sup s n ; lim sup s n is the largest value that infinitely 
many s n ’s can get close to. Similar remarks apply to lim inf s n . These 
remarks will be clarified in Theorem 11.8 and §12, where we will give 
a thorough treatment of lim inf’s and lim sup’s. For now, we need 
a theorem that shows (s n ) has a limit if and only if lim inf s n = 
lim sup s n . 

10.7 Theorem. 

Let (s n ) be a sequence in M. 

(i) If lim s n is defined [as a real number, +oo or — oo], then 
lim inf s n = lim s n = lim sup s n . 

(ii) If lim inf s n = lim sup s n , then lims n is defined and lims n = 
lim inf s n = lim sup s n . 

Proof 

We use the notation un = inf{s n : n > N }, vn = sup{s n : n > N}, 
u = limujv = lim inf s n and v = limujv = lim sup s n . 

(i) Suppose lim s n = +oo. Let M be a positive real number. Then 
there is a positive integer N so that 

n > N implies s n > M. 

Then un = infjs,,, : n > N} > M. It follows that m > N 
implies u m > M. In other words, the sequence (un) satisfies 
the condition defining limujv = +oo, i.e., lim inf s n = +oo. 
Likewise lim sup s n = +oo. 

The case lims n = —oo is handled in a similar manner. 
Now suppose lim s n = s where s is a real number. Consider 
e > 0. There exists a positive integer N such that |s n — s| < e 
for n > N. Thus s n < s + e for n > N, so 

vn = sup{s n : n > N} < s + e. 

Also, m > N implies v m < s+e, so lim sup s n = lirnu m < s+e. 
Since lim sup s n < s + e for all e > 0, no matter how small, we 
conclude lim sup s n < s = lims n . A similar argument shows 
lim s n < lim inf s n . Since lim inf s n < lim sup s n , we infer all 
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three numbers are equal: 

lim inf s n = lim s n = limsup s n . 

(ii) If lim inf s n = lim sup s n = +oo it is easy to show lim s n = 

+oo. And if lim inf s n = lim sup s n = —oo it is easy to show 

lim s n = —oo. We leave these two special cases to the reader. 

Suppose, finally, that lim inf s n = lim sup s n = s where s is 
a real number. We need to prove lims n = s. Let e > 0. Since 
s = limuTv there exists a positive integer No such that 

|s — sup{s n : n > ./Vo}| < e. 

Thus sup{s n : n > ./Vo} < s + e, so 

s n < s + e for all n > No- (1) 

Similarly, there exists Ni such that |s — inf{s n : n > iVi}| < e, 
hence inf{s n : n > > s — e, hence 

s n > s — e for all n > N\. (2) 

From (1) and (2) we conclude 

s — e < s n < s + e for n > max{7Vo, Ni}, 

equivalently 

|s n — s| < e for n > max (Wo, N\}. 

This proves lim s n = s as desired. ■ 

If (s n ) converges, then lim inf s n = lim sup s n by the theorem just 
proved, so for large N the numbers sup{s n : n > N } and inf{s n : 
n > N} are close together. This implies that all the numbers in the 
set {s n : n > N} are close to each other. This leads us to a concept of 
great theoretical importance that will be used throughout the book. 

10.8 Definition. 

A sequence (s n ) of real numbers is called a Cauchy sequence if 

for each e > 0 there exists a number N such that 

m,n> N implies |s n — s m \ < e. (1) 

Compare this definition with Definition 7.1. 
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10.9 Lemma. 

Convergent sequences are Cauchy sequences. 

Proof 

Suppose liiri s n = s. The idea is that, since the terms s n are close to 
s for large n, they also must be close to each other; indeed 

|Sn ~~ S m \ = — S + S — S m | < |s n — s| + |s — S m |. 

To be precise, let e > 0. Then there exists N such that 

n > N implies |s n — s| < —. 

Clearly we may also write 

m > N implies |s m — s| < —, 

so 

m,n > N implies |s n — s m | < |s n — s| + |s — s m | < — + - = e. 
Thus (s n ) is a Cauchy sequence. ■ 


10.10 Lemma. 

Cauchy sequences are bounded. 

Proof 

The proof is similar to that of Theorem 9.1. Applying Definition 10.8 
with e = 1 we obtain N in N so that 

m,n> N implies |s n — s m | < 1. 

In particular, |s n — sat + i| < 1 for n > N, so |s n | < |sjv+i| + 1 for 
n > N. If M = max{|s7v+i| + 1, |si|, |S 2 1, - - -, |sjv|}, then |s n | < M 
for all n G N. ■ 


The next theorem is very important because it shows that to 
verify that a sequence converges it suffices to check it is a Cauchy 
sequence, a property that does not involve the limit itself. 

10.11 Theorem. 

A sequence is a convergent sequence if and only if it is a Cauchy 
sequence. 
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Proof 

The expression “if and only if” indicates that we have two assertions 
to verify: (i) convergent sequences are Cauchy sequences, and (ii) 
Cauchy sequences are convergent sequences. We already verified (i) 
in Lemma 10.9. To check (ii), consider a Cauchy sequence (s n ) and 
note (s n ) is bounded by Lemma 10.10. By Theorem 10.7 we need 
only show 

liminf s n = limsup s n . (1) 

Let e > 0. Since (s n ) is a Cauchy sequence, there exists N so that 

m,n> N implies |s n — s m | < e. 

In particular, s n < s m + e for all m,n > N. This shows s m + e is an 
upper bound for {s n : n > N}, so vn = sup{s n : n > N} < s m + e 
for m > N. This, in turn, shows vn — e is a lower bound for {s m : 
m > IV}, so vn — e < inf{s m : m > N} = un. Thus 

lim sup s n < vn < un + e < lim inf s n + e. 

Since this holds for all e > 0, we have lim sup s n < lim inf s n . The 
opposite inequality always holds, so we have established (1). ■ 

The proof of Theorem 10.11 uses Theorem 10.7, and Theo¬ 
rem 10.7 relies implicitly on the Completeness Axiom 4.4, since 
without the completeness axiom it is not clear that lim inf s n and 
lim sup s n are meaningful. The completeness axiom assures us that 
the expressions sup{s n : n > N} and inf{s n : n > N} in Defini¬ 
tion 10.6 are meaningful, and Theorem 10.2 [which itself relies on 
the completeness axiom] assures us that the limits in Definition 10.6 
also are meaningful. 

Exercises on lim sup’s and lim inf’s appear in §§11 and 12. 


Exercises 


10.1 Which of the following sequences are increasing? decreasing? bounded? 

( a ) k ( b ) 


(c) n 5 

(e) (—2)” 


(d) sin(2f) 

(f) # 
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10.2 Prove Theorem 10.2 for bounded decreasing sequences. 

10.3 For a decimal expansion K.d\d 2 d^d 4 ■ ■ let (s„) be defined as in 

Discussion 10.3. Prove s n < K + 1 for all n £ N. Hint : + j §2 + 

-f- ^ = 1 - for all n. 

10.4 Discuss why Theorems 10.2 and 10.11 would fail if we restricted our 
world of numbers to the set Q of rational numbers. 

10.5 Prove Theorem 10.4(ii). 

10.6 (a) Let ( s n ) be a sequence such that 

|s„+i — s n | < 2~ n for all n £ N. 

Prove ( s n ) is a Cauchy sequence and hence a convergent 
sequence. 

(b) Is the result in (a) true if we only assume |s„ + i — s„| < ^ for all 
n £ N? 

10.7 Let S be a bounded nonempty subset of K such that sup S is not in S. 
Prove there is a sequence (s„) of points in S such that lim s n = sup S. 
See also Exercise 11.11. 

10.8 Let (s„) be an increasing sequence of positive numbers and define 
<r n = ^(si + S 2 + ■ ■ ■ + s n ). Prove ( a n ) is an increasing sequence. 

10.9 Let si = 1 and s n+ i = (^y)s^ for n > 1. 

(a) Find S 2 , S 3 and S 4 . 

(b) Show lim s n exists. 

(c) Prove finis™ = 0. 

10.10 Let si = 1 and s n+ i = |(s„ + 1) for n > 1. 

(a) Find S 2 , S 3 and S 4 . 

(b) Use induction to show s n > \ for all n. 

(c) Show (s n ) is a decreasing sequence. 

(d) Show lims n exists and find lim s n . 

10.11 Let t\ = 1 and t n+ \ = [1 — -^ 2 ] • t n for n > 1. 

(a) Show lim t n exists. 

(b) What do you think limt n is? 
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10.12 Let t\ = 1 and t n+ 1 = [1 - (ra ^ 1)2 ] • t n for n > 1. 

(a) Show limf„ exists. 

(b) What do you think limt n is? 

(c) Use induction to show t n = ^Ll. 

(d) Repeat part (b). 

§11 Subsequences 

11.1 Definition. 

Suppose (snjneN is a sequence. A subsequence of this sequence is a 
sequence of the form (tk) k £N where for each k there is a positive 
integer n k such that 

ni<n 2 < ■■■ <n k < n k +1 < • • • ( 1 ) 

and 

t k = s n k ■ ( 2 ) 

Thus ( t k ) is just a selection of some [possibly all] of the s n ’s taken 
in order. 

Here are some alternative ways to approach this concept. Note 
that (1) defines an infinite subset of N, namely {ni, n 2 , n ^,...}. Con¬ 
versely, every infinite subset of N can be described by (1). Thus a 
subsequence of (s n ) is a sequence obtained by selecting, in order, an 
infinite subset of the terms. 

For a more precise definition, recall we can view the sequence 
(sn)neN as a function s with domain N; see §7. For the subset 
{ni, n 2 , 713 ,..there is a natural function a [lower case Greek sigma] 
given by cr{k) = n k for k £ N. The function a “selects” an infinite 
subset of N, in order. The subsequence of s corresponding to a is 
simply the composite function t = s o a. That is, 

t k = t(k ) = s o a(k) = s(a(k)) = s(n k ) = s nk for k € N. (3) 

Thus a sequence t is a subsequence of a sequence s if and only if 
t = s o a for some increasing function ct mapping N into N. We will 
usually suppress the notation a and often suppress the notation t 
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also. Thus the phrase “a subsequence (s nk ) of (s n )” will refer to the 
subsequence defined by (1) and (2) or by (3), depending upon your 
point of view. 

Example 1 

Let (s n ) be the sequence defined by s n = n 2 (— l) n . The positive terms 
of this sequence comprise a subsequence. In this case, the sequence 
(sn) is 

(-1,4, -9,16, -25,36, -49, 64,...) 
and the subsequence is 

(4,16,36,64,100,144,...). 

More precisely, the subsequence is (s nfc )fc g N where rik=2k so 
that s nk =(2k) 2 {— 1) 2A =Ak 2 . The selection function a is given by 
a(k)=2k. □ 

Example 2 

Consider the sequence a n = sin(^) and its subsequence (a nk ) of 
nonnegative terms. The sequence (a n ) ng pj is 

|v"3,0,-|V3,-|x/3,0, |V3, |V3,0,-|x/3,-ix/3,0,...) 

and the desired subsequence is 

(|>/3, 0,0, |>/3, |>/3,0,0,...)- 

It is evident that ni = 1, ri 2 = 2, 77.3 = 3, 774 = 6 , 775 = 7, hq = 8, 
777 = 9, ns = 12, 779 = 13, etc. We won’t need a formula for rik, 
but here is one: nk = k + 2|_|j for k > 1, where |_a?J is the “floor 
function,” i.e., is the largest integer less than or equal to x , for 
x G M. □ 

After some reflection, the next theorem will seem obvious, but 
it is good to have a complete proof that covers all situations. The 
proof is a little bit complicated, but we will apply the theorem several 
times rather than having to recreate a similar proof several times. 5 
Thus it is important to understand the proof. 


5 In the first edition of this book, we did create similar proofs instead. 
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11.2 Theorem. 

Let (s n ) be a sequence. 

(i) Ift is in M, then there is a subsequence of (s n ) converging to t 
if and only if the set {n G N : |s n — t\ < e} is infinite for all 
e > 0. 

(ii) If the sequence ( s n ) is unbounded above, it has a subsequence 
with limit +oo. 

(iii) Similarly, if ( s n ) is unbounded below, a subsequence has limit 
—oo. 

In each case, the subsequence can be taken to be monotonic . 6 

Proof 

The forward implications in (i)-(iii) are all easy to check. For 
example, if lirri/j s Vk = t and e > 0, then all but finitely many of the 
nfcs are in {n G N : |s n — 1\ < e}. We focus on the other implications. 

(i) First suppose the set {n £ N : s n = t} is infinite. Then 
there are subsequences {s nk )keN such that s nk = t for all 
k. Such subsequences of (s n ) are boring monotonic sequences 
converging to t. 

Henceforth, we assume {n £ N : s n = t} is finite. Then 
{n G N : 0 < |s n — t\ < e} is infinite for all e > 0. 

Since these sets equal 

{n € N : t — e < s n < t} U {n G N : t < s n < t + e}, 
and these sets get smaller as e —> 0, we have 

{n G N : t — e < s n < t} is infinite for all e>0, (1) 

or 

{n G N : t < s n < t + e} is infinite for all e > 0; (2) 

otherwise, for sufficiently small e > 0, the sets in both (1) 
and (2) would be finite. 

We assume (1) holds, and leave the case that (2) holds 
to the reader. We will show how to define or construct 


6 This will be proved easily here, but is also a consequence of the more general 
Theorem 11.4. 
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step-by-step a subsequence (s nfc )fceN satisfying t— 1 < s ni < t 
and 


max 


S Ufc-l ,t /.I — Sn k 


< t for k > 2. 


(3) 


Specifically, we will assume n\, n 2 , ■ ■ ■ , rik -1 have been selected 
satisfying (3) and show how to select n^. This will give us an 
infinite increasing sequence (nk)k£n and hence a subsequence 
(s nk ) of (s n ) satisfying (3). Since we will have s nk _ 1 < s nk 
for all k, this subsequence will be monotonically increasing. 
Since (3) also will imply t — ^ < s nk < t for all k, we will have 
linifc s nk = t: compare Exercise 8.5(a) on page 44. 

A construction like the one described above, and executed 
below, is called an “inductive definition” or “definition by in¬ 
duction,” even though the validity of the process is not a direct 
consequence of Peano’s axiom N5 in § 1.' 

Here is the construction. Select ri\ so that t — 1 < s ni < 
f; this is possible by (1). Suppose ni,ri 2 , ■ ■ ■ ,rik-i have been 
selected so that 


ni < n 2 < • • • < rik-i (4) 

and 

max | s nj _ l , t - j | < s nj < t for j = 2,..., k - 1. (5) 

Using (1) with e = max{s nfc l ,t— ^}, we can select nk > rik -i 
satisfying (5) for j = k, so that (3) holds for k. The procedure 
defines the sequence (nk)keN- This completes the proof of (i), 
and is the crux of the full proof. 

(ii) Let ni = 1. say. Given rii < ■■■ < nk~i, select nk so that 
s nk > max{s 7lfc _ 1 , k}. This is possible, since (s n ) is unbounded 
above. The sequence so obtained will be monotonic and have 
limit Too. A similar proof verifies (iii). ■ 


7 Recursive definitions of sequences, which first appear in Exercises 9.4-9.6, can 
be viewed as simple examples of definitions by induction. 
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Example 3 

It can be shown that the set Q of rational numbers can be listed 
as a sequence (r n ), though it is tedious to specify an exact formula. 
Figure 11.1 suggests such a listing [with repetitions] where r± = 0, 
T 2 = 1, r 3 = Fp r 4 = —7™5 = —1, t 6 = —2, r 7 = —1, etc. Readers 
familiar with some set theory will recognize this assertion as “Q 
is countable.” This sequence has an amazing property: given any 
real number a there exists a subsequence (r nk ) of (r n ) converging to 
a. Since there are infinitely many rational numbers in every interval 
(a—e, a+e) by Exercise 4.11, Theorem 11.2 shows that a subsequence 
of (r n ) converges to a. □ 

Example 4 

Suppose (s n ) is a sequence of positive numbers such that inf{s n : 
n G N} = 0. The sequence (s n ) need not converge or even be 
bounded, but it has a subsequence converging monotonically to 0. By 
Theorem 11.2, it suffices to show {n G N : s n < e} is infinite for each 
e > 0. Otherwise, this set would be finite for some eo > 0. If the set 
is nonempty, then inf{s n : n 6 N} = min{s n : s n < eo} > 0, because 
each s n is positive and the set {s n : s n < eo} is finite. This contra¬ 
dicts our assumption inf{s n : n G N} = 0. If the set is empty, then 
inf{s n : n £ N} > to > 0, again contrary to our assumption. □ 

The next theorem is almost obvious. 




I 
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11.3 Theorem. 

If the sequence (s n ) converges, then every subsequence converges to 
the same limit. 

Proof 

Let (s nk ) denote a subsequence of (s n ). Note that > k for all k. 

This is easy to prove by induction; in fact, n\ > 1 and n^-i > k — 1 

implies nk > nk~\ > k — 1 and hence nk > k. 

Let s = lims n and let e > 0. There exists N so that n > N 

implies |s n — s| < e. Now k > N implies nk > IV, which implies 

|sn fc ~ s \ < e - Thus 

lim s nk = s. 

k—too 


Our immediate goal is to prove the Bolzano-Weierstrass theorem 
which asserts that every bounded sequence has a convergent sub¬ 
sequence. First we prove a theorem about monotonic subsequences. 


11.4 Theorem. 

Every sequence (s n ) has a monotonic subsequence. 

Proof 

Let’s say that the n-th term is dominant if it is greater than every 
term which follows it: 

s m < s n for all m > n. (1) 

Case 1. Suppose there are infinitely many dominant terms, and 
let (s nk ) be any subsequence consisting solely of dominant terms. 
Then s nk+1 < s nk for all k by (1), so (s„J is a decreasing sequence. 

Case 2. Suppose there are only finitely many dominant terms. Se¬ 
lect n\ so that s ni is beyond all the dominant terms of the sequence. 
Then 


given IV > ni there exists m > N such that s m > sn- (2) 

Applying (2) with N = n\ we select ri 2 > n\ such that s n2 > s ni . 
Suppose ni,ri 2 , ■ ■ ■, have been selected so that 


ni < 77,2 < ' • • < 77fc_ i 


( 3 ) 
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and 

•Sni 5; S n2 ^ ^ S nk _ 1 - (4) 

Applying (2) with IV = rik-i we select > n^_i such that s nfc > 
s nk _ i- Then (3) and (4) hold with k in place of k — 1, the procedure 
continues by induction, and we obtain an increasing subsequence 

i s n k )- ® 


The elegant proof of Theorem 11.4 was brought to our attention 
by David M. Bloom and is based on a solution in D. J. Newman’s 
beautiful book [48]. 

11.5 Bolzano-Weierstrass Theorem. 

Every bounded sequence has a convergent subsequence. 

Proof 

If (s n ) is a bounded sequence, it has a monotonic subsequence by 
Theorem 11.4, which converges by Theorem 10.2. ■ 

The Bolzano-Weierstrass theorem is very important and will be 
used at critical points in Chap. 3. Our proof, based on Theorem 11.4, 
is somewhat nonstandard for reasons we now discuss. Many of the 
notions introduced in this chapter make equally good sense in more 
general settings. For example, the ideas of convergent sequence, 
Cauchy sequence and bounded sequence all make sense for a se¬ 
quence (s n ) where each s n belongs to the plane. But the idea of 
a monotonic sequence does not carry over. It turns out that the 
Bolzano-Weierstrass theorem also holds in the plane and in many 
other settings [see Theorem 13.5], but clearly it would no longer be 
possible to prove it directly from an analogue of Theorem 11.4. Since 
the Bolzano-Weierstrass Theorem 11.5 generalizes to settings where 
Theorem 11.4 makes little sense, in applications we will emphasize 
the Bolzano-Weierstrass Theorem 11.5 rather than Theorem 11.4. 

We need one more notion, and then we will be able to tie our 
various concepts together in Theorem 11.8. 

11.6 Definition. 

Let (s n ) be a sequence in R. A subsequential limit is any real number 
or symbol +oo or —oo that is the limit of some subsequence of (s n ). 
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When a sequence has a limit s, then all subsequences have limit 
s, so {s} is the set of subsequential limits. The interesting case is 
when the original sequence does not have a limit. We return to some 
of the examples discussed after Definition 11.1. 

Example 5 

Consider (s n ) where s n = n 2 (—l) n . The subsequence of even terms 
diverges to +oo, and the subsequence of odd terms diverges to —oo. 
All subsequences that have a limit diverge to +oo or — oo, so that 
{—oo,+oo} is exactly the set of subsequential limits of (s n ). □ 

Example 6 

Consider the sequence a n = sin( r | I ) in Example 2. This sequence 
takes each of the values ~ \/3, 0 and — ^\/3 an infinite number of 
times. The only convergent subsequences are constant from some 
term on, and { — j\/3, 0, j\/3} is the set of subsequential limits of 
(i a n ). If rik = 3 k, then a nk = 0 for all k £ N and obviously 
lirn^oo a nk = 0. If n k = 6k T 1, then a nk = ^\/3 for all k and 
lim^oo a nk = \y/?>. And if n k = 6k + 4, then lim^o 0 a nk = 

— 7jA/3. □ 

Example 7 

Let ( r n ) be a list of all rational numbers. It was shown in Example 3 
that every real number is a subsequential limit of (r n ). Also, +oo 
and —oo are subsequential limits; see Exercise 11.7. Consequently, 
M U {—oo, Too} is the set of subsequential limits of ( [r n ). □ 

Example 8 

Let b n = n[l T (— l) n ] for n G N. Then b n = 2 n for even n and b n = 0 
for odd n. Thus the 2-elenrent set {0, Too} is the set of subsequential 
limits of ( b n ). □ 

We now turn to the connection between subsequential limits and 
lim sup’s and lim inf’s. 

11.7 Theorem. 

Let ( s n ) be any sequence. There exists a monotonic subsequence 
whose limit is limsups n , and there exists a monotonic subsequence 
whose limit is lim inf s n . 
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Proof 

If (s n ) is not bounded above, then by Theorem 11.2(H), a monotonic 
subsequence of (s n ) has limit +oo = limsup s n . Similarly, if (s n ) 
is not bounded below, a monotonic subsequence has limit —oo = 
lirninf s n . 

The remaining cases are that (s n ) is bounded above or is bounded 
below. These cases are similar, so we only consider the case that (s n ) 
is bounded above, so that liiri sup s n is finite. Let t = lirri sup s n , and 
consider e > 0. There exists Nq so that 

sup{s n : n > N} < t + e for N > Nq. 

In particular, s n < t + e for all n > No. We now claim 

{n € N : t — e < s n < t + e} is infinite. (1) 

Otherwise, there exists N± > Nq so that s n < t — e for n > N\. Then 
sup{s n : n > N} < t — e for N > N\, so that lirri sup s n < t, a contra¬ 
diction. Since (1) holds for each e > 0, Theorem 11.2(i) shows that 
a monotonic subsequence of (s n ) converges to t = lim sup s n . ■ 

11.8 Theorem. 

Let (s n ) be any sequence in M, and let S denote the set of 
subsequential limits of(s n ). 

(i) S is nonempty. 

(ii) sup S = lim sup s n and inf S = lirninf s n . 

(iii) lim s n exists if and only if S has exactly one element, namely 
lim s n . 

Proof 

(i) is an immediate consequence of Theorem 11.7. 

To prove (ii), consider any limit t of a subsequence (s nk ) of ( s n ). 
By Theorem 10.7 we have t = lim inf & s nk = limsup fc s nj .. Since 
nk > k for all k, we have {s nk : k > N} C : n > N} for each N 
in N. Therefore 

lirninf s n < lirninf s nk = t = lirri sup s nk < lirri sup .s n . 
n k k n 

This inequality holds for all t in 5; therefore 

lim inf s n < inf S < sup S < lim sup s n . 
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Theorem 11.7 shows that liminf s n and lim sup s n both belong to S. 
Therefore (ii) holds. 

Assertion (iii) is simply a reformulation of Theorem 10.7. ■ 

Theorems 11.7 and 11.8 show that lim sup s n is exactly the largest 
subsequential limit of (s n ), and liminf s n is exactly the smallest sub- 
sequential limit of (s n ). This makes it easy to calculate limsup’s and 
lim inf’s. 

We return to the examples given before Theorem 11.7. 
Example 9 

If s n = n 2 (—l) n , then S = {—oo,+oo} as noted in Example 5. 
Therefore lim sup s n = sup S = +oo and lim inf s n = inf S = 
—oo. □ 

Example 10 

If a n = sin(^), then S = { — ^\/3,0, as observed in Exam¬ 

ple 6. Hence lim sup a n = sup S = ^y/3 and lim inf a n = inf S = 
-^V3. □ 

Example 11 

If ( r n ) denotes a list of all rational numbers, then the set M U 
{—oo,+oo} is the set of subsequential limits of ( r n ). Consequently 
we have lim sup r n = +oo and liminf r n = —oo. □ 

Example 12 

If b n = n[ 1 + (—l) n ], then limsup6 n = Too and liminf b n = 0; see 
Example 8. □ 

The next result shows that the set S of subsequential lim¬ 
its always contains all limits of sequences from S. Such sets are 
called closed sets. Sets of this sort will be discussed further in the 
enrichment §13. 

11.9 Theorem. 

Let S denote the set of subsequential limits of a sequence ( s n ). Sup¬ 
pose ( t n ) is a sequence in S fl M and that t = lim t n . Then t belongs 
to S. 
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Proof 


Suppose t is finite. Consider the interval (t — e, t T e). Then some t n 
is in this interval. Let 5 = min{£ + e — t n , t n — t T e}, so that 


{t n — 8,t n + 8) C (t — e, t T e). 


Since t n is a subsequential limit, the set {n E N : s n € ( t n — 8 , t n + <5)} 
is infinite, so the set {n 6 N : s n € (t —e, t + e)} is also infinite. Thus, 
by Theorem 11.2(i), t itself is a subsequential limit of (s n ). 

If t = Too, then clearly the sequence (s n ) is unbounded above, 
so a subsequence of (s n ) has limit +oo by Theorem 11.2(h). Thus 
Too is also in S. A similar argument applies if t = —oo. ■ 

Exercises 

11.1 Let a„ = 3 + 2(—1)" for n £ N. 

(a) List the first eight terms of the sequence (. a n ). 

(b) Give a subsequence that is constant [takes a single value]. 


Specify the selection function er. 
11.2 Consider the sequences defined as follows: 

a n = (-1)”, b n = 


6n -1- 4 




n 


(a) For each sequence, give an example of a monotone subse¬ 
quence. 

(b) For each sequence, give its set of subsequential limits. 

(c) For each sequence, give its limsup and lirninf. 

(d) Which of the sequences converges? diverges to Too? diverges 
to —oo? 

(e) Which of the sequences is bounded? 

11.3 Repeat Exercise 11.2 for the sequences: 



11.4 Repeat Exercise 11.2 for the sequences: 
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11.5 Let (<?„) be an enumeration of all the rationals in the interval (0,1]. 

(a) Give the set of subsequential limits for ( q n ). 

(b) Give the values of lim sup q n and lim inf q n . 

11.6 Show every subsequence of a subsequence of a given sequence is itself 
a subsequence of the given sequence. Hint: Define subsequences as 
in (3) of Definition 11.1. 

11.7 Let ( r n ) be an enumeration of the set Q of all rational numbers. Show 
there exists a subsequence ( r nk ) such that lim^oo r nk = +oo. 

11.8 ★ 8 Use Definition 10.6 and Exercise 5.4 to prove lim inf s n = 
— limsup(— s n ) for every sequence ( s n ). 

11.9 (a) Show the closed interval [a, b] is a closed set. 

(b) Is there a sequence ( s n ) such that (0,1) is its set of subsequential 
limits? 

11.10 Let ( s n ) be the sequence of numbers in Fig. 11.2 listed in the indicated 
order. 

(a) Find the set S of subsequential limits of (s„). 

(b) Determine lim sup s n and lim inf s n . 


This exercise is referred to in several places. 
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11.11 Let S be a bounded set. Prove there is an increasing sequence (s n ) of 
points in S such that lims^ = sup S'. Compare Exercise 10.7. Note: 
If supS is in S, it’s sufficient to define s n = supS for all n. 


§12 

lim sup’s and lim inf’s 


Let (s n ) be any sequence of real numbers, and let S be the set of 
subsequential limits of (s n ). Recall 


lim sup s n = lim sup{s n : n > N} = sup S 

N —^oo 

(*) 

and 

lim inf s n = lim inf {s n : n > N} = inf S. 

N—yoo 



The first equalities in (*) and (**) are from Definition 10.6, and 
the second equalities are proved in Theorem 11.8. This section is de¬ 
signed to increase the students’ familiarity with these concepts. Most 
of the material is given in the exercises. We illustrate the techniques 
by proving some results that will be needed later in the text. 

12.1 Theorem. 

If (s n ) converges to a positive real numbers and (t n ) is any sequence, 
then 

lim sup s n t n = s ■ lirri sup t n . 

Here we allow the conventions s ■ (+oo) = +oo and s ■ (—oo) = — oo 
for s > 0. 

Proof 

We first show 

lim sup s n t n > s ■ lim sup t n . (1) 

We have three cases. Let (3 = lim sup t n . 

Case 1. Suppose /3 is finite. 

By Theorem 11.7, there exists a subsequence (t nk ) of ( t n ) such 
that linifc^oo t nk = f3. We also have lim^oo s nk = s [by Theo¬ 
rem 11.3], so linifc^oo s n . k t nk = s/3. Thus ( s nk t nk ) is a subsequence of 
( s n t n ) converging to s/3, and therefore s(3 < lim sup s n t n . [Recall that 
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limsups n f n is the largest possible limit of a subsequence of (s n t n ).] 
Thus (1) holds. 

Case 2. Suppose f3 = +oo. 

There exists a subsequence ( [t nk ) of ( t n ) such that Hindoo t nk = 
Too. Since lim^oo s nk = s > 0, Theorem 9.9 shows lim^oo s nk t nk = 
Too. Hence limsups n f n = Too, so (1) clearly holds. 

Case 3. Suppose /3 = —oo. 

Since s > 0, the right-hand side of (1) is equal to s ■ (—oo) = —oo. 
Hence (1) is obvious in this case. 

We have now established (1) in all cases. For the reversed in¬ 
equality, we resort to a little trick. First note that we may ignore 
the first few terms of (s n ) and assume all s n 0. Then we can write 
lim — = - by Lemma 9.5. Now we apply (1) with s n replaced by 
and t n replaced by s n t n : 

lim sup t n = lim sup \ — ] ( s n t n ) > f - J lim sup s n t n , 

\Sn \s 


i.e., 


limsups^fn < s ■ lim sup t n . 

This inequality and (1) prove the theorem. ■ 

Example 1 

The hypothesis s be positive in Theorem 12.1 cannot be relaxed to 
allow s = 0. To see this, consider ( s n ) and ( t n ), where s n = — ^ and 
t n = — n 2 for all n. In this setting, we don’t define 0- (—oo), but even 
if we did, we wouldn’t define this product to be Too. □ 


The next theorem will be useful in dealing with infinite series; 
see the proof of the Ratio Test 14.8. 

12.2 Theorem. 

Let ( s n ) be any sequence of nonzero real numbers. Then we have 


lim inf 


^ 71+1 


< lim inf |s n | 1//n < lim sup \s n \ l ^ n < lim sup 


•Sn+l 
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Proof 

The middle inequality is obvious. The first and third inequalities 
have similar proofs. We will prove the third inequality and leave the 
first inequality to Exercise 12.11. 

Let a = lim sup I s n 1 1 ' n and L = lim sup I I. We need to prove 
a < L. This is obvious if L = +oo, so we assume L < +oo. To prove 
a < L it suffices to show 


a < L\ for any L\ > L. 


( 1 ) 


Since 


L = lim sup 


Sn+l 


= lim sup 

TV—>-oo 


^n+1 


n > N > < L 


there exists a positive integer N such that 

^n+l 


sup 


Thus 


Sn+1 


: n> N > <L\. 


< L\ for n> N. 


(2) 


Now for n > N we can write 


Sr). — 


Sn 


Sn— 1 


SN+1 

Sn—l 


Sn -2 


sn 


\sn\- 


There are n — (N + 1) + 1 = n — N fractions here, so applying (2) 
we see that 

|s n | < L™~ n \sn\ for n > N. 

Since L\ and N are fixed in this argument, a = L^lsjvl is a positive 
constant and we may write 


|s n | < L^a for n > N. 


Therefore we have 


|s n | 1/n < L x a x l n for n > N. 

Since lim^^oo a 1 /™ = 1 by Theorem 9.7(d) on page 48, we conclude 
a = lirnsup |s n | 1,/n < Li; see Exercise 12.1. Consequently (1) holds 
as desired. ■ 
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12.3 Corollary. 

If lim|^ ±i | exists [and equals L], then lim exists [and 

equals L]. 

Proof 

If lim I %±I| = L, then all four values in Theorem 12.2 are equal to L. 
Hence lim |s n | ly/n = L; see Theorem 10.7. ■ 

Example 2 

(a) If L = lim sup s n ^ oo, then for every a > L, the set {n : 
s n > a} is finite. If L ^ —oo, then for every (3 < L, the set 
{n : s n > (3} is infinite. 

If L ^ oo and a > L, the set {n : s n > a} is finite; otherwise 
sup{s n : n > N} > a for all N and hence L = lim sup s n > 
a > L, a contradiction; see Definition 10.6. If L / —oo and 
f3 < L, the set {n : s n > /5} is infinite; otherwise there exists a 
positive integer Nq so that s n < /3 for all n > Nq, and therefore 
sup{s n : n > N } < (3 for all N > Nq. Then lim sup s n < (3 < L, 
a contradiction. 

(b) The set {n : s n > lim sup can be infinite. For example, 
consider ( s n ) where s n = K The set {n : s n < lim inf s n } can 
also be infinite; use s n = — K 

(c) If Lo = lim inf t n ^ —oo, then the set {n : t n < /3o} is finite for 
A) < Lq. If L 0 ± oo, then the set {n : t n < a o} is infinite for 
ot 0 > Lq. 

This follows from part (a) and Exercise 11.8: 

Lo = lim inf t n = — limsup(— t n ) = — L = — lim sup s n , 

where s n = —t n and L is as defined in part (a). Now A) < Lo 
implies — A > —Lo = L, so by part (a), 

{n :t n < /3 0 } = {n : - t n > - fo} = {n : s n > —/3 0 } is finite. 

Similarly, ao > Lo implies — «o < L, so 

{n : t n < ao} = { n : —t n > —ao} = {n : s n > —«o} is infinite. 

(d) If lim inf s n < lim sup s n , the set 

{n : lim inf s n < s n < lim sup 

can be empty. Use, for example, s n = (—l) n (l + -). □ 
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Exercises 

12.1 Let (s„) and (t n ) be sequences and suppose there exists No such that 
s n < tn for all n > No. Show lim inf s n < lim inf t n and lim sup s n < 
lim sup £ n . Hint: Use Definition 10.6 and Exercise 9.9(c). 

12.2 Prove lim sup |s n | = 0 if and only if lim s n = 0. 

12.3 Let (s n ) and (t n ) be the following sequences that repeat in cycles of 
four: 

(«») = ( 0 , 1 , 2 , 1 , 0 , 1 , 2 , 1 , 0 , 1 , 2 , 1 , 0 , 1 , 2 , 1 , 0 ,...) 

(t n ) = (2,1,1,0,2,1,1,0,2,1,1,0,2,1,1,0,2,...) 

Find 

(a) lim inf s n + liminf t n , (b) lim inf (s n + t n ), 

(c) liminf s n + lim sup t n , (d) limsup(s„ + t n ), 

(e) limsup s n + limsupt„, (f) liminf(s n f n ), 

(g) limsup(s n f„) 

12.4 Show limsup(s„+£„) < limsup s n + lim sup t n for bounded sequences 
(s n ) and (t n ). Hint: First show 

sup{s„ + t n : n > N} < sup{s„ : n > N} + sup{t n : n > N}. 

Then apply Exercise 9.9(c). 

12.5 Use Exercises 11.8 and 12.4 to prove 

lim inf (s n + t n ) > liminf s n + liminf t n 
for bounded sequences (s n ) and (t n ). 

12.6 Let (s„) be a bounded sequence, and let k be a nonnegative real 
number. 

(a) Prove limsup(fcs rt ) = k • lim sup s n . 

(b) Do the same for liminf. Hint: Use Exercise 11.8. 

(c) What happens in (a) and (b) if k < 0? 

12.7 Prove if lim sup s n = +oo and k > 0, then limsup(fcs n ) = +oo. 

12.8 Let (s„) and (t n ) be bounded sequences of nonnegative numbers. 
Prove limsups n f„ < (limsups n )(limsupt ra ). 

12.9 (a) Prove that if lims n = +oo and lim inf t n > 0, then lims^t^ = 

+oo. 

(b) Prove that if lim sup s n = +oo and lim inf t n > 0, then 
limsups n t„ = +oo. 
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(c) Observe that Exercise 12.7 is the special case of (b) where t n = k 
for all n £ N. 

12.10 Prove (s„) is bounded if and only if limsup |s n | < +oo. 

12.11 Prove the first inequality in Theorem 12.2. 

12.12 Let (s n ) be a sequence of nonnegative numbers, and for each n define 

O'n = “(Si + s 2 + ’ ' ' + S n ). 

(a) Show 

liminf s n < lim inf cr„ < limsup a n < limsup s n . 

Hint: For the last inequality, show first that M > N implies 

sup{tr n ■ n > M} < -(si + s 2 H-hSAr) + sup{s„ : n > N}. 

(b) Show that if lims„ exists, then lim<r„ exists and limcr n = 
lim s n . 

(c) Give an example where lim a n exists, but lim s n does not exist. 

12.13 Let (s n ) be a bounded sequence in R. Let A be the set ofa€l such 
that {n £ N : s n < a} is finite, i.e., all but finitely many s n are > a. 
Let B be the set of b € R. such that {n G N : s n > b} is finite. Prove 
sup A = lim inf s n and inf B = lim sup s n . 

12.14 Calculate (a) lim(n!) 1 / n , (b) lim ^(n!) 1 /". 

§13 * Some Topological Concepts in Metric 

Spaces 

In this book we are restricting our attention to analysis on M. Ac¬ 
cordingly, we have taken full advantage of the order properties of R 
and studied such important notions as lim sup’s and lim inf’s. In §3 
we briefly introduced a distance function on R. Most of our analy¬ 
sis could have been based on the notion of distance, in which case 
it becomes easy and natural to work in a more general setting. For 
example, analysis on the ^-dimensional Euclidean spaces R fc is im¬ 
portant, but these spaces do not have the useful natural ordering 
that R has, unless of course k = 1. 
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13.1 Definition. 

Let S be a set, and suppose d is a function defined for all pairs (x, y ) 
of elements from S satisfying 

Dl. d(x,x) = 0 for all x E S and d(x,y) > 0 for distinct x,y in S. 
D2. d(x,y) = d(y,x ) for all x,y e S. 

D3. d(x, z ) < d(x, y) + d(y, z ) for all x,y,z € S. 

Such a function d is called a distance function or a metric on S. 
A metric space S' is a set S together with a metric on it. Properly 
speaking, the metric space is the pair (S, d) since a set S may well 
have more than one metric on it; see Exercise 13.1. 


Example 1 

As in Definition 3.4, let dist(a, b) = |a — b\ for a, b 6 R. Then dist is 
a metric on M. Note Corollary 3.6 gives D3 in this case. As remarked 
there, the inequality 

dist(a, c) < dist (a, b) + dist(6, c) 

is called the triangle inequality. In fact, for any metric d, property 
D3 is called the triangle inequality. □ 


Example 2 

The space of all fc-tuples 


x = (xi, X2, ■ ■ ■, Xk) where Xj € M for j = 1 , 2,..., k, 

is called k-dimensional Euclidean space and written M fc . As noted in 
Exercise 13.1, has several metrics on it. The most familiar metric 
is the one that gives the ordinary distance in the plane R 2 or in 
3-space R 3 : 


d(x,y) 


1/2 


~ Vi? 

3 = 1 


for x, y 6 R fc . 


[The summation notation ^ is explained in 14.1.] Obviously this 
function d satisfies properties Dl and D2. The triangle inequality 
D3 is not so obvious. For a proof, see for example [53, §6.1] or 
[62, 1.37]. □ 
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13.2 Definition. 

A sequence (s n ) in a metric space (S,d) converges to s in S if 
lim n _ KX) d(s n , s) = 0. A sequence (s n ) in S is a Cauchy sequence 
if for each e > 0 there exists an N such that 

m,n>N implies d(s m ,s n )<e. 

The metric space (S, d) is said to be complete if every Cauchy 
sequence in S converges to some element in S. 


Since the Completeness Axiom 4.4 deals with least upper bounds, 
the word “complete” now appears to have two meanings. However, 
these two uses of the term are very closely related and both reflect the 
property that the space is complete, i.e., has no gaps. Theorem 10.11 
asserts that the metric space (M, dist) is a complete metric space, and 
the proof uses the Completeness Axiom 4.4. We could just as well 
have taken as an axiom the completeness of (M, dist) as a metric space 
and proved the least upper bound property in 4.4 as a theorem. We 
did not do so because the concept of least upper bound in M seems 
to us more fundamental than the concept of Cauchy sequence. 

We will prove is complete. But we have a notational problem, 
since we like subscripts for sequences and for coordinates of points 
in R fc . When there is a conflict, we will write (au n i) for a sequence 
instead of {x n ). In this case, 


An) _ (An) An) 

tXy - ^ it/ 2 j • • • i %Jb 


( n )'i 

k ) 


Unless otherwise specified, the metric in is always as given in 
Example 2. 


13.3 Lemma. 

A sequence (au n l) in M fc converges if and only if for each j = 
1,2 the sequence {x^) converges in M. A sequence (x^) 

in is a Cauchy sequence if and only if each sequence (x^) is a 
Cauchy sequence in M. 

Proof 

The proof of the first assertion is left to Exercise 13.2(b). For the 
second assertion, we first observe for x, y in and j = 1, 2,..., k, 

I xj -yj | < d(x,y) < Vkmax{\xj - yj \ : j = 1,2 ,...,fc}. (1) 
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Suppose ( x ( n )) is a Cauchy sequence in R fc , and consider fixed j. 
If e > 0, there exists TV such that 

m,n > TV implies d{x^ m \x^) < e. 

From the first inequality in (1) we see that 

m,n > TV implies \ x ^ ~ < e > 

so {Xj 1 ' 1 ) is a Cauchy sequence in M. 

Now suppose each sequence (x^) is a Cauchy sequence in R. Let 
e > 0. For j = 1,2,..., k, there exist Nj such that 

m,n > Nj implies | x^ — xf^\ < —j=. 

J J Vk 

If TV = max{TVi, TV 2 ,..., TV^}, then by the second inequality in (1), 
m,n> N implies d(x^ m \x^) < e, 
i.e., ( x is a Cauchy sequence in R fc . ■ 

13.4 Theorem. 

Euclidean k-space R fc is complete. 

Proof 

Consider a Cauchy sequence (x^) in M fc . By Lemma 13.3, (x^ n> ) 
is a Cauchy sequence in M for each j. Hence by Theorem 10.11, 
(x^) converges to some real number xj. By Lemma 13.3 again, the 
sequence (x^) converges, in fact to x = (xi, X 2 , ■ • •, x &). ■ 

We now prove the Bolzano-Weierstrass theorem for M fc ; compare 
Theorem 11.5. A set S in M. k is bounded if there exists M > 0 such 
that 

max{|xj| : j = 1, 2,..., k} < M for all x = (xi, X 2 , ■ ■ ■, X&) € S. 

13.5 Bolzano-Weierstrass Theorem. 

Every bounded sequence in R fc has a convergent subsequence. 

Proof 

Let (®( n )) be a bounded sequence in R fc . Then each sequence (x^) 
is bounded in R. By Theorem 11.5, we may replace ( x by a 
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subsequence such that (x^) converges. By the same theorem, we 
may replace (x^ n ' ) ) by a subsequence of the subsequence such that 
converges. Of course, (xj"' 1 ) still converges by Theorem 11.3. 
Repeating this argument k times, we obtain a sequence (x^) so 
that each sequence (x^) converges, j = 1,2This sequence 
represents a subsequence of the original sequence, and it converges 
in by Lemma 13.3. ■ 

13.6 Definition. 

Let (S, d) be a metric space. Let E be a subset of S. An element 
so £ E is interior to E if for some r > 0 we have 

{s £ S : d(s, so) < r} C E. 

We write E° for the set of points in E that are interior to E. The 
set E is open in S if every point in E is interior to E , i.e., if E = E°. 

13.7 Discussion. 

One can show [Exercise 13.4] 

(i) S is open in S [trivial]. 

(ii) The empty set 0 is open in S [trivial]. 

(iii) The union of any collection of open sets is open. 

(iv) The intersection of finitely many open sets is again an open 

set. □ 

Our study of and the exercises suggest that metric spaces are 
fairly general and useful objects. When one is interested in conver¬ 
gence of certain objects [such as points or functions], there is often 
a metric that assists in the study of the convergence. But sometimes 
no metric will work and yet there is still some sort of convergence no¬ 
tion. Frequently the appropriate vehicle is what is called a topology. 
This is a set S for which certain subsets are decreed to be open sets. 
In general, all that is required is that the family of open sets satisfies 
(i)-(iv) above. In particular, the open sets defined by a metric form a 
topology. We will not pursue this abstract theory. However, because 
of this abstract theory, concepts that can be defined in terms of open 
sets [see Definitions 13.8, 13.11, and 22.1] are called topological, hence 
the title of this section. 
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13.8 Definition. 

Let ( S , d) be a metric space. A subset E of S is closed if its comple¬ 
ment S\E is an open set. In other words, E is closed if E = S \ U 
where U is an open set. 

Because of (iii) in Discussion 13.7, the intersection of any collec¬ 
tion of closed sets in closed [Exercise 13.5]. The closure E~ of a set 
E is the intersection of all closed sets containing E. The boundary 
of E is the set E~ \ E°\ points in this set are called boundary points 
of E. 

To get a feel for these notions, we state some easy facts and leave 
the proofs as exercises. 

13.9 Proposition. 

Let E be a subset of a metric space (S,d ). 

(a) The set E is closed if and only if E = E~. 

(b) The set E is closed if and only if it contains the limit of every 
convergent sequence of points in E. 

(c) An element is in E~ if and only if it is the limit of some 
sequence of points in E. 

(d) A point is in the boundary of E if and only if it belongs to the 
closure of both E and its complement. 

Example 3 

In M, open intervals (a, b ) are open sets. Closed intervals [a, b] are 
closed sets. The interior of [a, b] is (a, b). The boundary of both (a, b) 
and [a, b\ is the two-element set {a, 6}. 

Every open set in M is the union of a disjoint sequence of open 
intervals [Exercise 13.7]. A closed set in M need not be the union of 
a disjoint sequence of closed intervals and points; such a set appears 
in Example 5. 

No open interval (a, b) or closed interval [a,b\, with a < b, can 
be written as the disjoint union of two or more closed intervals, each 
having more than one point. This is proved in Theorem 21.11. □ 

Example 4 

In M fc , open balls {x : d(x,x o) < r} are open sets, and closed balls 
{x : d(x,x o) < r} are closed sets. The boundary of each of these 
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sets is {x : d(x, xq) = r}. In the plane R 2 , the sets 

{(xi,X 2 ) : x\ > 0} and {(x\,X 2 ) ■ x\ > 0 and X 2 > 0} 

are open. If > is replaced by >, we obtain closed sets. Many sets 
are neither open nor closed. For example, [0,1) is neither open nor 
closed in R, and {(x\,X 2 ) : x\ > 0 and X 2 > 0} is neither open nor 
closed in R 2 . □ 

13.10 Theorem. 

Let (F n ) be a decreasing sequence [i.e., F\ D F 2 A ■ • •] of closed 
bounded nonempty sets in R fc . Then F = D ™ =1 F n is also closed, 
bounded and nonempty. 

Proof 

Clearly F is closed and bounded. It is the nonemptiness that 
needs proving! For each n, select an element x n in F n . By the 
Bolzano-Weierstrass Theorem 13.5, a subsequence (x nm )™ =1 of (x n ) 
converges to some element xq in R fc . To show xq E F, it suf¬ 
fices to show xq E F no with no fixed. If m > no, then n m > no, 
so x Hm E F nm C F no . Hence the sequence (x nm )™ =no consists of 
points in F no and converges to xo- Thus xq belongs to F no by (b) of 
Proposition 13.9. ■ 

Example 5 

Here is a famous nonempty closed set in R called the Cantor set. 
Pictorially, F = n^ =1 F n where F n are sketched in Fig. 13.1. The 
Cantor set has some remarkable properties. The sum of the lengths of 
the intervals comprising F n is (|) n 1 and this tends to 0 as n —> 00 . 
Yet the intersection F is so large that it cannot be written as a 
sequence; in set-theoretic terms it is “uncountable.” The interior 
of F is the empty set, so F is equal to its boundary. For more details, 
see [62, 2.44], or [31, 6.62], □ 

13.11 Definition. 

Let (S, d) be a metric space. A family U of open sets is said to be an 
open cover for a set E if each point of E belongs to at least one set 
in U, i.e., 


E C [J{U : U E U}. 
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FIGURE 13.1 


A subcover of U is any subfamily of U that also covers E. A cover 
or subcover is finite if it contains only finitely many sets; the sets 
themselves may be infinite. 

A set E is compact if every open cover of E has a finite subcover 
of E. 

This rather abstract definition is very important in advanced 
analysis; see, for example, [30]. In R fc , compact sets are nicely 
characterized, as follows. 

13.12 Heine-Borel Theorem. 

A subset E of R fc is compact if and only if it is closed and bounded. 

Proof 

Suppose E is compact. For each m E N, let U m consist of all x in 
R fc such that 


max{|xj| : j = 1, 2,..., k} < m. 

The family U = {U m : m 6 N} is an open cover of E [it covers R fc !], 
so a finite subfamily of U covers E. If U mo is the largest member of 
the subfamily, then E C U mo . It follows that E is bounded. To show 
E is closed, consider any point xq in R fc \ E. For m E N, let 


Kn 


E R fc : d(x, xq ) > 



m 
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Then each V m is open in and V = {V m : m € N} covers E since 
U™ =1 V m = \ {xq}. Since E can be covered by finitely many V m , 

for some mo we have 

E C I x € M fc : d(x, Xq ) > — 1 . 

I m 0 J 

Thus {x 6 : d(x,x o) < C \ E, so that xq is interior to 

~R k \E. Since xq in M. k \E was arbitrary, M. k \E is an open set. Hence 
E is a closed set. 

Now suppose E is closed and bounded. Since E is bounded, E is 
a subset of some set F having the form 

F = {x G R fc : \xj\ < m for j = 1, 2,..., k}. 

As noted in Exercise 13.12, it suffices to prove F is compact. We do 
so in the next proposition after some preparation. ■ 


The set F in the last proof is a k-cell because it has the following 
form. There exist closed intervals [ai, b\\, [ 02 , b?\, ..., [a^, 6fc] so that 

F = {x € R fc : Xj G [fij , bj] for j = 1,2,, k}, 

which is sometimes written as 


F = [ai, bi] x [a 2 ,b 2 ] x ■ ■ ■ x [a k , b k ], 


so it is a /c-dimensional box in M fc . Thus a 2-cell in M 2 is a closed 
rectangle. A 3-cell in M 3 is called a “rectangular parallelepiped.” The 
diameter of F is 


<5 = 


1 1/2 


a j ) 


i=l 


that is, <5 = sup {d(x,y) : x,y G F}. Using midpoints Cj = : T (aj + b 0 ) 
of [ctj,bj], we see that F is a union of 2 k fc-cells each having diameter 
If this remark is not clear, consider first the cases k = 2 and k = 3. 


13.13 Proposition. 

Every k-cell F in is compact. 

Proof 

Assume F is not compact. Then there exists an open cover U of F, no 
finite subfamily of which covers F. Let <5 denote the diameter of F. 
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As noted above, F is a union of 2 k /c-cells having diameter 7 . At least 
one of these 2 k /c-cells, which we denote by F\, cannot be covered 
by finitely many sets from U. Likewise, F\ contains a fc-cell F 2 of 
diameter j which cannot be covered by finitely many sets from IA. 
Continuing in this fashion, we obtain a sequence (F n ) of fc-cells such 
that 

F x D F 2 D F 3 D • • •; (1) 

F n has diameter 5 ■ 2~ n ; (2) 

F n cannot be covered by finitely many sets from U. (3) 

By Theorem 13.10, the intersection n^ =1 F n contains a point xq. This 
point belongs to some set Uq'w.U. Since Uq is open, there exists r > 0 
so that 

{x £ : d(x, * 0 ) < r} C Uq. 

It follows that F n C Uq provided 5 ■ 2~ n < r, but this contradicts (3) 
in a dramatic way. ■ 

Since M = M 1 , the preceding results apply to M. 

Example 6 

Let E be a nonempty subset of a metric space ( S,d ). Consider the 
function d(E,x ) = inf{d(y,.x) : y £ E} for x £ S. This function 
satisfies \d(E,x 1 ) — d(E, x 2 )\ < d(xi,x 2 ) for x\,x 2 in S. 

We show that if E is compact and if E C U for some open subset 
U of S, then for some 5 > 0 we have 

{x £ S : d(E,x ) < 6} C. U. (1) 

For each x £ E, we have 

{y £ S : d(y,x ) < r x } C U for some r x > 0. (2) 

The open balls {y £ S : d(y, x ) < r x /2} cover E, so a finite subfamily 
also covers E. I.e., there are aq,..., x n in E so that 

n 

E C (J |y £ S : d(y,x k ) < yj , 

k =1 

where we write for r Xk . Now let 6 = ^ minjri,..., r n }. To 
prove (1), consider x £ S and suppose d(E,x) < 5. Then for some 
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y 6 E, we have d(y,x) < 6. Moreover, d(y,x k ) < -y for some 
k £ {1,2,..., ra}. Therefore, for this k we have 

d(x, x k ) < d(x, y) + d(y , x k ) < S + y < y + y = Dc- 

Thus, by (2) applied to x = x k , we see that x belongs to U. Hence (1) 
holds. □ 


Exercises 

13.1 For points a:, y in K fe , let 

di{x,y) =max{|a; J -%| : j = 1 , 2 ,..., k} 

and 

k 

d2(x,y) =^2\x j -y j \. 

j =i 

(a) Show di and d ,2 are metrics for K fc . 

(b) Show d\ and d 2 are complete metrics on R fc . 

13.2 (a) Prove (1) in Lemma 13.3. 

(b) Prove the first assertion in Lemma 13.3. 

13.3 Let B be the set of all bounded sequences x = (xi,X 2 , ■ ■ •), and define 
d(x,y) = sup{|xj - yj\ :j = 1,2 ,...}. 

(a) Show d is a metric for B. 

(b) Does d*(x, y) = \ x j ~~ Vj\ define a metric for B7 

13.4 Prove (iii) and (iv) in Discussion 13.7. 

13.5 (a) Verify one of DeMorgan’s Laws for sets: 

P| {S' \U :U GU} = S\ P{H : U £ U}. 

(b) Show that the intersection of any collection of closed sets is a 
closed set. 

13.6 Prove Proposition 13.9. 

13.7 Show that every open set in R is the disjoint union of a finite or 
infinite sequence of open intervals. 
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13.8 (a) Verify the assertions in the first paragraph of Example 3. 

(b) Verify the assertions in Example 4. 

13.9 Find the closures of the following sets: 

(a) {± : n £ N}, 

(b) Q, the set of rational numbers, 

(c) {r £ Q : r 2 < 2 }. 

13.10 Show that the interior of each of the following sets is the empty set. 

(a) {± : n £ N}, 

(b) Q, the set of rational numbers, 

(c) The Cantor set in Example 5. 

13.11 Let E be a subset of R fc . Show that E is compact if and only if every 
sequence in E has a subsequence converging to a point in E. 

13.12 Let (S,d) be any metric space. 

(a) Show that if E is a closed subset of a compact set F, then E 
is also compact. 

(b) Show that the finite union of compact sets in S is compact. 

13.13 Let £ be a compact nonempty subset of R. Show supE and inf E 
belong to E. 

13.14 Let E be a compact nonempty subset of R fe , and let 5 = sup{d(;c, y) : 
x,y £ E}. Show E contains points x$, y Q such that d(xo,y 0 ) = 5. 

13.15 Let (B, d) be as in Exercise 13.3, and let F consist of all x £ B such 
that sup{|xj| : j = 1,2 ,...} < 1. 

(a) Show F is closed and bounded. [A set F in a metric space 
(S, d) is bounded if there exist sq £ S and r > 0 such that 
F C {s € S : d(s, s 0 ) < r}.] 

(b) Show F is not compact. Hint: For each x in F, let U{x) = 
{y £ B : d(y, x) < 1}, and consider the cover U of F consist¬ 
ing of all U(x). For each n £ N, let x^ be defined so that 
Xn"' ) = — 1 and x^ = 1 for j n. Show that distinct x( n ' ) 
cannot belong to the same member of U. 
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§14 Series 

Our thorough treatment of sequences allows us to now quickly obtain 
the basic properties of infinite series. 

14.1 Summation Notation. 

The notation Ylk=m a k is shorthand for the sum a ?n +a m+ i + - • ■ +a n . 
The symbol instructs us to sum and the decorations “k = m” 
and “n” tell us to sum the summands obtained by successively sub¬ 
stituting m, m + 1 , ..., n for k. For example, Ylk= 2 k 2 +k shorthand 
for 

1 , 1 , 1 , 1 _ 1 , 1 , 1 , 1 

2 2 + 2 + 3 2 + 3 + 4 2 + 4 + 5 2 + 5 _ 6 + 12 + 20 + 30 

and Ylk=o 2~ k is shorthand for 1 + ^ + \ + ■ ■ ■ + ^. 

The symbol Y^=m a n is shorthand for a m + a m+ 1 + a m+2 H-, 

although we have not yet assigned meaning to such an infinite sum. 
We now do so. □ 


14.2 Infinite Series. 

To assign meaning to a ", we consider the sequences (s n )^ =m 

of partial sums : 

n 

Sn = a m + ttm+1 + ‘ ‘ ‘ + «n = Ofc- 

k=m 


The infinite series a n sa ^ to converge provided the sequence 

(s n ) of partial sums converges to a real number S, in which case we 
define Y^= m a n = S. Thus 


OO 

a n = S means lim s n 

n=m 


s 


or 


lim 

n—> oo 


E 

\k=m 


&k 


s. 


A series that does not converge is said to diverge. We say that 
Yl^Lm a n diverges to +oo and we write Y^= m a n = +°° provided 
lim s n = +oo; a similar remark applies to —oo. The symbol Y^= m 
has no meaning unless the series converges, or diverges to +oo or 
—oo. Often we will be concerned with properties of infinite series 
but not their exact values or precisely where the summation begins, 
in which case we may write ^ a n rather than a «- 
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If the terms a n of an infinite series Y a n are all nonnegative, 
then the partial sums (s n ) form an increasing sequence, so Theo¬ 
rems 10.2 and 10.4 show that Y a n either converges, or diverges 
to Too. In particular, Y \ a n\ is meaningful for any sequence (a n ) 
whatever. The series Y a n is said to converge absolutely or to be ab¬ 
solutely convergent if Y \ a n\ converges. Absolutely convergent series 
are convergent, as we shall see in Corollary 14.7. □ 


Example 1 

A series of the form ar ” n f° r constants a and r is called a 

geometric series. These are the easiest series to sum. For r ^ 1, the 
partial sums s n are given by 


Y, ark 

k=0 


= a- 


l _ r n+l 

1 — r 


(1) 


This identity can be verified by mathematical induction or by mul¬ 
tiplying both sides by 1 — r, in which case the right hand side equals 
a — ar n+1 and the left side becomes 


( i ~ r )J2 ark 

k=0 


y ar k -J2 ark+l 

k=0 fc=0 


= a + ar + ar 2 -\ -+ ar n 


— (ar T ar 2 -|- h ar n + ar n+1 ) 


= a — ar 


71+1 


For |r| < 1, we have lim n _ > . 00 r n+1 = 0 by Theorem 9.7(b) on page 48, 
so from (1) we have lim^^oo s n = jY- This proves 

OO 

Y ar n = ——— if |r| < 1. (2) 

z —' 1 - r 

n =0 

If a ^ 0 and |r| > 1, then the sequence ( ar n ) does not converge to 
0, so the series Y arU diverges by Corollary 14.5 below. □ 


Example 2 

Formula (2) of Example 1 and the next result are very important 
and both should be used whenever possible, even though we will not 
prove (1) below until the next section. Consider a fixed positive real 
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number p. Then 


oo 


E 

n= 1 


1 

nP 


converges if and only if p > 1. 


( 1 ) 


In particular, for p < 1, we can write E l/n p = +oo. The exact 
values of the series for p > 1 are not easy to determine. Here are 
some remarkable formulas that can be shown by techniques [Fourier 
series or complex variables, to name two possibilities] that will not 
be covered in this text. 


E£i£ = £ = 1-6449- (2) 

E~ i£ = £ = 1-0823--. (3) 

Similar formulas hold for EnLi ~v when p is any even integer, but 
no such elegant formulas are known for p odd. In particular, no such 
formula is known for E»Ei ^3 though of course this series converges 
and can be approximated as closely as desired. □ 


It is worth emphasizing that it is often easier to prove limits exist 

or series converge than to determine their exact values. In the next 

section we will show without much difficulty that E converges for 

2 

all p > 1, but it is a lot harder to show the sum is ^ when p = 2 
and no one knows exactly what the sum is for p = 3. 

14.3 Definition. 

We say a series E a n satisfies the Cauchy criterion if its sequence 
(s n ) of partial sums is a Cauchy sequence [see Definition 10.8]: 

for each e > 0 there exists a number N such that 

m,n> N implies |s n — s m \ < e. (1) 

Nothing is lost in this definition if we impose the restriction n > m. 
Moreover, it is only a notational matter to work with m — 1 where 
m < n instead of m where m < n. Therefore (1) is equivalent to 

for each e > 0 there exists a number N such that 
n > m > N implies |s n — s m _i| < e. 


( 2 ) 
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Since s n — s m _i = Yk= m a ki condition (2) can be rewritten 
for each e > 0 there exists a number N such that 


n > m > N implies 


X ak 

k=m 


< e. 


( 3 ) 


We will usually use version (3) of the Cauchy criterion. 
Theorem 10.11 implies the following. 


14.4 Theorem. 

A series converges if and only if it satisfies the Cauchy criterion. 


14.5 Corollary. 

If a series Y a n converges, then lima n = 0. 

Proof 

Since the series converges, (3) in Definition 14.3 holds. In particu¬ 
lar, (3) in 14.3 holds for n = m\ i.e., for each e > 0 there exists a 
number N such that n > N implies \a n \ < e. Thus lima n = 0. ■ 


The converse of Corollary 14.5 does not hold as the example 
Y l/ n = +°° shows. 

We next give several tests to assist us in determining whether a 
series converges. The first test is elementary but useful. 

14.6 Comparison Test. 

Let Y a n be a series where a n > 0 for all n. 

(i) IfY a n converges and \b n \ < a n for all n, then Y bn converges. 

(ii) IfY a n = +oo and b n > a n for all n, then Ybn = +oo. 

Proof 

(i) For n> m we have 

n n n 

X bk - XI n - X (1) 

k=m k=m k=m 

the first inequality follows from the triangle inequality [Ex¬ 
ercise 3.6(b)]. Since Y a n converges, it satisfies the Cauchy 
criterion 14.3(1). It follows from (1) that Ybn also satisfies 
the Cauchy criterion, and hence Y bn converges. 
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(ii) Let (s n ) and (t n ) be the sequences of partial sums for Y a n and 
Y b n , respectively. Since b n > a n for all n, we obviously have 
tn > s n for all n. Since lims n = +oo, we conclude limt n = 
+oo, i.e., Y b n = +oo. ■ 

14.7 Corollary. 

Absolutely convergent series are convergent . 9 

Proof 

Suppose Y b n is absolutely convergent. This means Y a n converges 
where a n = \b n \ for all n. Then \b n \ < a n trivially, so Y b n converges 
by 14.6(i). ■ 

We next state the Ratio Test which is popular because it is often 
easy to use. But it has defects: It isn’t as general as the Root Test. 
Moreover, an important result concerning the radius of convergence 
of a power series uses the Root Test. Finally, the Ratio Test is worth¬ 
less if some of the a n ’s equal 0. To review lim sup’s and lim inf’s, see 
Definition 10.6, Theorems 10.7 and 11.8, and §12. 

14.8 Ratio Test. 

A series Y a n of nonzero terms 

(i) converges absolutely */lim sup |a n +i/a n | < 1, 

(ii) diverges */lim inf \a n+ i/a n \ > 1. 

(iii) Otherwise liminf |a n +i/a n | < 1 < limsup |a n +i/a n | and the 
test gives no information. 

We give the proof after the proof of the Root Test. 

Remember that if lim |a n +i /a n \ exists, then it is equal to both 
lim sup |a n +i/a n | and liminf |a n +i/a n | and hence the Ratio Test will 
give information unless, of course, the limit lim |a n +i/a n | equals 1. 

14.9 Root Test. 

Let Y a n be a series and let a = lim sup |a n | 1,/n . The series Y a n 

(i) converges absolutely if a < 1 , 

(ii) diverges if a > 1 . 


9 As noted in [35], the proofs of this corollary and the Alternating Series 
Theorem 15.3 use the completeness of M. 
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(iii) Otherwise a = 1 and the test gives no information. 

Proof 

(i) Suppose a < 1, and select e > 0 so that a + e < 1. Then by 
Definition 10.6 there is a positive integer N such that 

a — e < sup{|a n | 1/,ri : n > ./V} < a + e. 

In particular, we have |a n | ly/n < a + e for n > N, so 

\a n \ < (a + e) n for n > N. 

Since 0 < a + e < 1, the geometric series ^^Ar+i( a + e ) Tl con " 
verges and the Comparison Test shows the series ^^Lat+i o, n 
also converges. Then clearly converges; see Exercise 14.9. 

(ii) If a > 1, then by Theorem 11.7 a subsequence of |o n I 1 /™ has 
limit a > 1. It follows that \a n \ > 1 for infinitely many choices 
of n. In particular, the sequence ( a n ) cannot possibly converge 
to 0, so the series a n cannot converge by Corollary 14.5. 

(iii) For each of the series - and 4j, a turns out to equal 1 
as can be seen by applying Theorem 9.7(c) on page 48. 
Since ^ - diverges and ^ converges, the equality a = 1 
does not guarantee either convergence or divergence of the 
series. ■ 


Proof of the Ratio Test 

Let a = limsup \a n \ l ^ n . By Theorem 12.2 we have 


lim inf 


®rt+1 
Q"ri 


< a < limsup 


®n+1 


(1) 


If limsup |a n+ i/a n | < 1, then a < 1 and the series converges by the 
Root Test. If lim inf \a n+ \/a n \ > 1, then a > 1 and the series diverges 
by the Root Test. Assertion 14.8(iii) is verified by again examining 
the series 1/n and 1/n 2 . ■ 


Inequality (1) in the proof of the Ratio Test shows that the Root 
Test is superior to the Ratio Test in the following sense: Whenever 
the Root Test gives no information [i.e., a = 1] the Ratio Test will 
surely also give no information. On the other hand, Example 8 below 
gives a series for which the Ratio Test gives no information but 
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which converges by the Root Test. Nevertheless, the tests usually 
fail together as the next remark shows. 

14.10 Remark. 

If the terms a n are nonzero and if lim |a n +i/a n | = 1, then a = 
lim sup | a n | 1//n = 1 by Corollary 12.3, so neither the Ratio Test nor 
the Root Test gives information concerning the convergence of Y a n- 

We have three tests for convergence of a series [Comparison, Ra¬ 
tio, Root], and we will obtain two more in the next section. There is 
no clearcut strategy advising us which test to try first. However, if 
the form of a given series Y a n does not suggest a particular strat¬ 
egy, and if the ratios a n+ i/a n are easy to calculate, one may as well 
try the Ratio Test first. 

Example 3 

Consider the series 

M sJ “ 9 ~~ 27 + 81~ 243 + ’”' 

This is a geometric series and has the form YnLo ar?l ^ we W1 ’it e if 
as (1/9) —1/3)^. Here a = 1/9 and r = —1/3, so by (2) of 

Example 1 the sum is (l/9)/[l — (—1/3)] = 1/12. 

The series (1) can also be shown to converge by the Comparison 
Test, since ]>/ l/3 n converges by the Ratio Test or by the Root Test. 
In fact, if a n = (—l/3) n , then lim |a n+ i/a n | = limsup |a n | 1,/n = 1/3. 
Of course, none of these tests will give us the exact value of the 
series (1). □ 

Example 4 

Consider the series 

Tl 

!f a n = , then 

n z + 3 

a n - |_i n + 1 n 2 + 3 n + 1 n 2 + 3 

a n (n + 1) 2 + 3 n n n 2 + 2n + 4’ 
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so lim \a n +i/cLn\ = 1- As noted in 14.10, neither the Ratio Test nor 
the Root Test gives any information in this case. Before trying the 
Comparison Test we need to decide whether we believe the series 
converges or not. Since a n is approximately 1 /n for large n and since 
52(1 /n) diverges, we expect the series (1) to diverge. Now 

n n n 1 

n 2 + 3 — n 2 + 3n 2 4n 2 4n 

Since 52(l/ n ) diverges, 52( V 4n) also diverges [its partial sums are 
s n /4 where s n = 52a!=i (1/^)] ? so (1) diverges by the Comparison 
Test. □ 


Example 5 

Consider the series 

ErfTT' (1) 

As the reader should check, neither the Ratio Rest nor the Root Test 
gives any information. The nth term is approximately Aj and in fact 
yirpY < Aj-. Since 52 converges, the series (1) converges by the 
Comparison Test. □ 

Example 6 

Consider the series 

££• w 

If a n = n/3 n , then a n+ \/a n = (n + l)/(3n), so lim|a n+ i/a n | = 
1/3. Hence the series (1) converges by the Ratio Test. In this case, 
applying the Root Test is not much more difficult provided we recall 
limn 1 / Tl = 1. It is also possible to show (1) converges by comparing 
it with a suitable geometric series. □ 


Example 7 

Consider the series 


(-l) n -3j ' v ' 

The form of a n suggests the Root Test. Since |a n | 1//n = 1 for even 
n and lanl 1 /” = 1/2 for odd n, we have a = lim sup | a n \ 1 ! n = 1. 


E 


a„ where a„ = 
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So the Root Test gives no information, and the Ratio Test cannot 
help either. On the other hand, if we had been alert, we would have 
observed a n = 1 for even n, so (a n ) cannot converge to 0. Therefore 
the series (1) diverges by Corollary 14.5. □ 


Example 8 

Consider the series 


„ 11 1 1 1 

2 2 _n = 2 + - + - + — + - + — + 
n =0 


16 8 64 


(1) 


Let a n = 2( -1 ) n ~ n . Since a n < for all n, we can quickly conclude 
the series converges by the Comparison Test. But our real interest in 
this series is that it illustrates the difference between the Ratio Test 
and the Root Test. Since a n+ \/a n = 1/8 for even n and a n+ \/a n = 2 
for odd n, we have 


1 r - r a n +1 

- = Inn mi - 

8 a n 


< 1 < limsup 


®n+1 
Q>n 


= 2 . 


Hence the Ratio Test gives no information. 

Note that (a n ) 1//n = 2" 1 for even n and (a n ) 1//n = 2"” 1 for 
odd n. Since lim2™ = lim2 _ " = 1 by Theorem 9.7(d) on page 48, 
we conclude lim {a n ) l ^ n = Therefore a = limsup(a re ) 1//n = \ < 1 
and the series (1) converges by the Root Test. □ 


Example 9 

Consider the series 


E 

n= 1 


(-i ) n+1 

\fn 


= 1 


1 ( 1 


1 ( i 

2 + 7! 


(i) 


Since lim yjn/(n + 1) = 1, neither the Ratio Test nor the Root Test 
gives any information. Since ^ ^ diverges, we will not be able to 
use the Comparison Test 14.6(i) to show (1) converges. Since the 
terms of the series (1) are not all nonnegative, we will not be able to 
use the Comparison Test 14.6(h) to show (1) diverges. It turns out 
that this series converges by the Alternating Series Test 15.3 which 
we have deferred to the next section. □ 
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Exercises 


14.1 Determine which of the following series converge. Justify your 


answers, 
(a) £^ 
(0 £ 1 - 
(e) £^ 


( b )E£ 

(d)E^ 

(f) En=2E^ 


14.2 Repeat Exercise 14.1 for the following. 

( & )Et (b)E(-D 

(c)E^ (d)E# 

( e ) E yr (f) E 

(g) ££ 


14.3 Repeat Exercise 14.1 for the following. 

(a)E^r (b)£^ 

(c) Erk (d)£(§)"(50+£) 

(e)Esin(^) (f)E^ 

14.4 Repeat Exercise 14.1 for the following. 

(a) En =2 I^+FW (b) nV^TT-V^ 

(c) 

14.5 Suppose £ a„ = A and £ b n = B where A and B are real numbers. 
Use limit theorems from §9 to quickly prove the following. 


(a) £(a n + b n ) — A + B. 

(b) £ ka n = kA for k € R. 

( c ) Is £ a nb n = AB a reasonable conjecture? Discuss. 

14.6 (a) Prove that if £ \a n \ converges and (b n ) is a bounded sequence, 

then £ a n b n converges. Hint: Use Theorem 14.4. 

(b) Observe that Corollary 14.7 is a special case of part (a). 

14.7 Prove that if £ a n is a convergent series of nonnegative numbers and 
p > 1, then £ converges. 

14.8 Show that if £ a n and £ b n are convergent series of nonnegative 
numbers, then £ \Ja n b n converges. Hint: Show y/a n b n < a n + b n for 
all n. 


14.9 The convergence of a series does not depend on any finite number of 
the terms, though of course the value of the limit does. More precisely, 
consider series £ a n and £ b n and suppose the set {n S N : a n ^ b n } 
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is finite. Then the series both converge or else they both diverge. 
Prove this. Hint : This is almost obvious from Theorem 14.4. 

14.10 Find a series E a n which diverges by the Root Test but for which 
the Ratio Test gives no information. Compare Example 8. 

14.11 Let (a n ) be a sequence of nonzero real numbers such that the sequence 
(up - ) ra ti° s is a constant sequence. Show E a n is a geometric 
series. 


14.12 Let (a„) rie N be a sequence such that lim inf \a n \ = 0. Prove there is 
a subsequence (a nk )keN such that EfcLi converges. 

14.13 We have seen that it is often a lot harder to find the value of an 
infinite sum than to show it exists. Here are some sums that can be 
handled. 


(a) Calculate £~=i(§) n and E~ iK)"- 

(b) Prove En=i ^pr+TT = L Hint ' Note that Ek=i fc(FFiy = 

V” [-_L_1 

Z^fc=ilfc fc+iJ- 


(c) Prove E“i p+t = p Hint ■ Note pit = p - p^T- 

(d) Use (c) to calculate E^=i p- 

14.14 Prove E^=i n diverges by comparing with the series 2 w here 
(a n ) is the sequence 


11111111111111111 
2’ 4’ 4’ 8’ 8’ 8’ 8’ 16’ 16’ 16’ 16’ 16’ 16’ 16’ 16’ 32’ 32’"‘' - 


§15 Alternating Series and Integral Tests 

Sometimes one can check convergence or divergence of series by 
comparing the partial sums with familiar integrals. We illustrate. 


Example 1 

We show E „ = ^~°°‘ 

Consider the picture of the function f(x) = - in Fig. 15.1. For 
n > 1 it is evident that 


n 


E 


1 

k 


Sum of the areas of the first n rectangles in Fig. 15.1 
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> Area under the curve — between 1 and n + 1 

x 



— dx 
x 


log e (n + 1). 


Since lim^^oo log e (n + 1) = +oo, we conclude „ = +oo- 

The series — diverges very slowly. In Example 7 on page 120, 
we observe Yln=i n i s approximately log e N + 0.5772. Thus for N = 
1,000 the sum is approximately 7.485, and for N = 1,000,000 the 
sum is approximately 14.393. □ 


Another proof that ^ — diverges was indicated in Exercise 14.14. 
However, an integral test is useful to establish the next result. 


Example 2 

We show converges. 

Consider the graph of fix) = hr Fig- 15.2. Then we have 



k=1 


Sum of the areas of the first n rectangles 


< 1 + 



= 2 - 


1 

n 


< 2 


for all n > 1. Thus the partial sums form an increasing sequence 
that is bounded above by 2. Therefore ^ converges and its 
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y 



sum is less than or equal to 2. Actually, we have already mentioned 

2 

[without proof!] that the sum is = 1.6449 

Note that in estimating Ylk =l W we n °t simply write 

i < fo dx, even though this is true, because this inte¬ 

gral is infinite. We were after a finite upper bound for the partial 
sums. □ 

The techniques just illustrated can be used to prove the following 
theorem. 


15.1 Theorem. 

w> converges if and only if p > 1. 


Proof 

Supply your own picture and observe that if p > 1, then 



1 + 


p — 1 


1 - 


nP 


'-i 


< 1 + 


p — 1 


P 

p — 1 


Consequently Yln=i ^ < +°°- 

Suppose 0 < p < 1. Then ~ ^ for all n. Since y diverges, 

we see that ^ diverges by the Comparison Test. ■ 


15.2 Integral Tests. 

Here are the conditions under which an integral test is advisable: 

(a) The tests in §14 do not seem to apply. 

(b) The terms a n of the series ^ a n are nonnegative. 
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(c) There is a nice decreasing function / on [1, oo) such that /(n) = 
a n for all n [/ is decreasing if x < y implies f(x) > f(y)]. 

(d) The integral of / is easy to calculate or estimate. 

If lirrijj^oo J" f(x) dx = +oo, then the series will diverge just 
as in Example 1. If lim^oo f” f(x) dx < +oo, then the series will 
converge just as in Example 2. The interested reader may formulate 
and prove the general result [Exercise 15.8]. □ 

The following result enables us to conclude that series like 
2 J v ^ converge even though they do not converge absolutely. See 
Example 9 in §14. 

15.3 Alternating Series Theorem. 

If a i >02 > ■ ■ ■ > a n > ■ ■ ■ >0 and lim a n = 0, then the al¬ 
ternating series l) n+1 a n converges. Moreover , the partial sums 
s n = Ylk=i(~ l ) k+la k satisfy |s - s n | < a n for all n. 

The series I) n &n is called an alternating series because the 
signs of the terms alternate between + and —. 

Proof 

We need to show that the sequence ( s n ) converges. Note that the 
subsequence (s 2 n) is increasing because S 2 n +2 — S 2 n = —« 2 n +2 + 
« 2 n+i > 0. Similarly, the subsequence (s 2 n-i) is decreasing since 
s2 n+l — S2n-1 = 02n+l — 0-2n < 0. We claim 

S2m < S2n+1 for all TO, 71 £ N. (1) 

First note that S 2 n < S 2 n+i for all n, because S 2 n +i—S 2 n = 02 n+i > 0. 
If to < n, then (1) holds because S 2 m < S 2 n < S 2 n +i- If to > n, 
then (1) holds because S 2 n+i > S 2 m +i > S 2 m- Thanks to (1), we 
see that (s 2 n) is an increasing subsequence of (s n ) bounded above 
by each odd partial sum, and (s 2 n+i) is a decreasing subsequence 
of ( s n ) bounded below by each even partial sum. By Theorem 10.2, 
these subsequences converge, say to s and t. Now 

t- s = lim S 2 n+i - lim s 2 n = lim (s 2n +i - s 2n ) = lim a 2n +i = 0, 

n—>oo n—>• oo n—>• oo n^-oo 

so s = t. It follows that lim n s n = s. 
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To check the last claim, note that s 2 fc < s < s 2 fc+i> so both 
S 2 fe+i-s and s-s 2 fc are clearly bounded by s 2 fc+i-s 2 fc = a 2 k+i < a 2k . 
So, whether n is even or odd, we have |s — s n \ < a n . ■ 


Exercises 


15.1 Determine which of the following series converge. Justify your 
answers. 


(a) E 


(~i) n 

n 


(b)E 


2 n 


15.2 Repeat Exercise 15.1 for the following. 

(a) (b) UM^fT 

15.3 Show J2n=2 n(iog n) p converges if and only if p > 1. 


15.4 Determine which of the following series converge. Justify your 


answers. 


(a) E 
( c ) E 


OO 1 

n —2 log n 

oo l 

n —4 n(log n)(log log n) 


(b) E^=2 
(d) E ^=2 


log n 
n 

log n 


15.5 Why didn’t we use the Comparison Test to prove Theorem 15.1 for 
p > 1? 

15.6 (a) Give an example of a divergent series E a n for which E a n 

converges. 

(b) Observe that if E a n is a convergent series of nonnegative terms, 
then E a n a l so converges. See Exercise 14.7. 

(c) Give an example of a convergent series E a n for which E a n 
diverges. 


15.7 (a) Prove if ( a n ) is a decreasing sequence of real numbers and if E a n 
converges, then lim na n = 0. Hint : Consider |a,/v+i+aAr +2 + - • • + 
a n | for suitable N. 

(b) Use (a) to give another proof that E n diverges. 


15.8 Formulate and prove a general integral test as advised in 15.2. 


§16 * Decimal Expansions of Real Numbers 

We begin by recalling the brief discussion of decimals in Discus¬ 
sion 10.3. There we considered a decimal expansion K.did 2 d 3 ■ ■ •, 
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where K is a nonnegative integer and each digit dj belongs to 
{0,1,2,3,4,5,6, 7,8,9}. This expansion represents the real number 



which we also can write as 


n 



lim s n where 


Thus every such decimal expansion represents a nonnegative real 
number. We will prove the converse after we formalize the process 
of long division. The development here is based on some suggestions 
by Karl Stromberg. 

16.1 Long Division. 

Consider a/b where a and b are positive integers. Since the K term 
above causes no difficulty, we assume a <b. We analyze the familiar 
long division process which gives a decimal expansion for a/b. Fig¬ 
ure 16.1 shows the first few steps where a = 3 and b = 7. If we name 
the digits g?i, cfe, g? 3, ... and the remainders n.j J"2,?"3, • • •, then so far 
d\ = 4, d 2 = 2 and r\ = 2, r2 = 6. At the next step we divide 7 into 
60 = 10 • r2 and obtain 60 = 7 • 8 + 4. The quotient 8 becomes the 
third digit d 3, we place the product 56 under 60, subtract and obtain 
a new remainder 4 = r%. That is, we are calculating the remainder 


.42 d 3 d x = 4 d 2 = 2 
7| 3.0000 

2 8 r x = 2 


20 

14 r 2 = 6 
"60 


FIGURE 16.1 
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obtained by dividing 60 by 7. Next we multiply the remainder = 4 
by 10 and repeat the process. At each stage 

d n € {0,1,2,3,4,5,6,7,8,9} 
r n = 10 • r n _i - 7 ■ d n 
0 < r n < 7. 

These results hold for n = 1,2,... if we set tq = 3. In general, we 
set ro = a and obtain 


d n G {0,1,2,3,4,5,6,7,8,9} 
v n — 10 v n —\ b • d n 
0 < r n < b. 

As we will show, this construction yields: 

a d\ 1 r\ 

b ~ 10 + 10 T 


and 


a d± 

b = Td + 


+ 


10 r 


1 r n 

f 10 n b' 


( 1 ) 

(2) 

(3) 


(4) 


(5) 


for n > 2. Since each r n is less than b, we have lim n - = 0, so (5) 
shows 


a 

b 


OO 7 

E ‘ 


3 = 1 


10 ? 


thus .d\d 2 d 3 • • • is a decimal expansion for |. 

Now Eq. (4) follows from n = 10a — bd\, and we will verify (5) 
by mathematical induction. From (2), we have 

_ i n , j _ 1 i .1 r n+ 1 

^n+l — 10r n bd n - |_i, SO —— — — — Mn-)-l + ~r r • 

b 10 10 b 


Substituting this into (5) gives 


® di d n d n -\-1 

b “ 10 + " ’ + 10" + 10"+! 10™+! ~b 


1 r n+ 1 


( 6 ) 


i.e., (5) holds with n replaced by n + 1. Thus by induction, (5) holds 
for all n. □ 
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16.2 Theorem. 

Every nonnegative real number x has at least one decimal expansion. 


Proof 

It suffices to consider x in [0,1). The proof will be similar to that for 
results in 16.1, starting with Eqs. (4) and (5) in its proof. We will 
use the “floor function” |_ j on R, where [y\ is defined to be the 
largest integer less than or equal to y, for each y G M. 

Since lOx < 10, we can write 


lOx = d\+x\ where d\ = [10xJ and x\ 6 [0,1). (1) 

Note di is in {0,1, 2,3,..., 9} since lOx < 10. Therefore 

(2) 


d\ 1 

"“To + ir 1 ' 


Suppose, for some n > 1, we have chosen di,...,d n in {0,1,2,3, 
..., 9} and xi,..., x n in [0,1) so that 


d i 


dr. 


x ~w + '" + W + W Xn - 


(3) 


Since 10x n < 10, we can write 


10x n = d n+ 1 + x n+ i where d n+ 1 = [10x n J,x n+ i G [0,1). (4) 

Solving for x n in (4) and substituting the value in (3), we get 


_ d\ d n -\. i 1 

x ~ io io n+1 io n+1 Xn+1 

This completes the induction step. Since lim n 1Q ^ +1 x n+ \ = 0, we 
conclude 


n +1 


dn 


JL 


o° j 

E ’ 


10 -? 


x = lim > 

n J 

j =1 3=1 

so that .d\d 2 ds • • • is a decimal expansion for x. 


As noted in Discussion 10.3, 1.000 • • • and 0.999 • • • are decimal 
expansions for the same real number. That is, the series 


1 + 0 ' 10_j 
i=i 


and ^ 9-10 J 
3=1 
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have the same value, namely 1. Similarly, 2.75000 • • • and 2.74999 • • • 
are both decimal expansions for Exercise 16.1]. The next theorem 
shows this is essentially the only way a number can have distinct 
decimal expansions. 

16.3 Theorem. 

A real number x has exactly one decimal expansion or else x has two 
decimal expansions, one ending in a sequence of all 0 ’s and the other 
ending in a sequence of all 9 ’s. 

Proof 

We assume x > 0. If x has decimal expansion if. 000 • • • with K > 0, 
then it has one other decimal expansion, namely (K — 1).999 • • •. If 
x has decimal expansion K.d\d 2 d 3 ■ ■ • d r 000 • • • where d r 7 ^ 0 , then it 
has one other decimal expansion K.d\d 2 d^ ■ ■ ■ (d r — 1)9999 • • •. The 
reader can easily check these claims [Exercise 16.2]. 

Now suppose x has two distinct decimal expansions K.d\d 2 d^ ■ ■ ■ 
and L.eie 2 e 3 • • •. Suppose K < L. If any dj < 9, then by Exercise 16.3 
we have 


x < K + 9-10 J = K + 1 < L < x, 

i=i 

a contradiction. It follows that x = K + 1 = L and its decimal 
expansions are AT.999 • • • and ( K + 1).000 • • •. In the remaining case, 
we have K = L. Let 


m = min{j : dj 7 ^ ej}. 

We may assume d m < e m . If dj < 9 for any j > m, then by 
Exercise 16.3, 


<K + J2 dj ■ 10~ j + 9 ■ 10 ~ j = K + ^Z d J- 10_i + l0_m 

1=1 j=m+ 1 1=1 

m— 1 m 

= K+J2 e j- 10 ” j + dm ■ 10~ m + 10" m < K + ^ej ■ 10~ j < x, 
l=i l=i 
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a contradiction. Thus dj = 9 for j > m. Likewise, if ej > 0 for any 
j > m, then 

m m— 1 

x > K + e j ■ W~ j = K+J2 d j • + e m ■ 10~ m 

j=i i=i 

m— 1 

> K +J2 d 3 ■ 10_i + d m ■ 10" m + 10" m 
3 = 1 

m oo 

= K + ^ dj ■ 10~ j + ^ 9 • 10~ j > x, 

j= 1 j=m+l 

a contradiction. So in this case, dj = 9 for j > m, e m = d m + 1 and 
ej = 0 for j > m. ■ 

16.4 Definition. 

An expression of the form 

K.did 2 ■ ■ ■ dedt + 1 • • • dt +r 

represents the decimal expansion in which the block dg+\ ■ ■ ■ di+ r is 
repeated indefinitely: 

K.d\d 2 ■ ■ ■ dide + i ■ ■ ■ d^ +r d^ + i ■ ■ ■ d£ +r di + i ■ ■ ■ di +r di + \ ■ ■ ■ d^ +r 
We call such an expansion a repeating decimal. 


Example 1 

Every integer is a repeating decimal. For example, 17 
17.000 • • •. Another simple example is 


.8 = .888 ...=J^8- 10~ j 

i=i 


10 


5> 

3=0 


8 10 

To' ¥ 


17.0 = 

8 

9' 

□ 


Example 2 

The expression 3.967 represents the repeating decimal 3.9676767 • • •. 
We evaluate this as follows: 

3.967 = 3 + 9 • 10” 1 + 6 • 10" 2 + 7 • 10" 3 + 6 • 10 -4 + 7 • 10" 5 + • • • 

OO 

= 3 + 9 • 10" 1 + 67 • 10” 3 ^(10 _2 y 

3=0 
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= 3 + 9- 10 _1 + 67 - 1(T 3 

_ 3,928 _ 1,964 
990 ““ 495 



. 9 67 

3 + — +- 

10 990 


Thus the repeating decimal 3.967 represents the rational number 
. Any repeating decimal can be evaluated as a rational number 
in this way, as we’ll show in the next theorem. □ 


Example 3 

We find the decimal expansion for -y-. By the usual long division 
process in 16.1, we find 

— = 1.571428571428571428571428571428571 
7 

i.e., y = 1.571428. To check this, observe 


1.571428 = 1 + 571,428 • 1(T 6 ^(10 _6 y = 1 + 

l=o 


571,428 

999,999 



11 

T' 


□ 


Many books give the next theorem as an exercise, probably to 
avoid the complicated notation. If the details seem too complicated 
to you, move on to Examples 4-7. 


16.5 Theorem. 

A real number x is rational if and only if its decimal expansion is 
repeating. [ Theorem 16.3 shows that if x has two decimal expansions, 
they are both repeating .] 


Proof 

First assume x > 0 has a repeating decimal expansion x = 
I\.d\d 2 ■ ■ ■ didi + 1 • • • di +r . Then 


where 


e 

x = K + ^dj- 10 _i + KT^y 

i=i 


V — -de+i ■ ■ ■ di +r 
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so it suffices to show y is rational. To simplify the notation, we write 


V — -eie 2 ■ ■ ■ e r . 


A little computation shows 


y = 4' 10 J 

3 = 1 


oo 


E< lir + 

3=0 


r 


= J2 e r^- j 

3=1 


10 r 

io r - 1 ' 


Thus y is rational. In fact, if we write eie 2 ■ ■ ■ e r for the usual decimal 
E'=(’ e j ' 1CT -1- - 7 not the product , then y = ; see Example 3. 

Next consider any positive rational, say | where a, b G N. We 
may assume a < b. As we saw in 16.1, | is given by the decimal 
expansion .444 •• • where ro = a, 


4 G {0,1,2,3,4, 5,6, 7,8,9} (1) 

rk = 10 ■ r fc _i - d k b (2) 

0 < r fc < b, (3) 

for k > 1. Since a and 6 are integers, each r k is an integer. Thus (3) 
can be written 


r k € {0,1,2,... , b — 1} for k>0. (4) 

This set has b elements, so the first 6 + 1 remainders r k cannot all 
be distinct. That is, there exist integers m > 0 and p > 0 so that 

0<m<m + p<6 and r m = r m+p . 

From the construction giving (l)-(3) it is clear that given r k ~ i, the 
integers r k and 4 are uniquely determined. Thus 

rj=r k implies r j+ i = r k+ i and d j+ ± = 4 + 1 - 

Since r m = r m+p , we conclude r m+i = r rn+ \ +p and d m+ ± = d m+1+p . 
A simple induction shows that the statement 

r k r k+p and d k dfc+p 

holds for all integers k > m + 1. Thus the decimal expansion of | is 
periodic with period p after the first m digits. That is, 


a 


•44 ■ ■ ■ 4i4i+1 ■ ■ ■ d m+p . 
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Remark. Given r^-i, the uniqueness of rk and dk follows from 
the so-called “division algorithm,” which is actually a theorem that 
shows the algorithm for division never breaks down. It says that if 
b is a positive integer and m E Z, then there are unique integers q 
and r so that 

m = bq + r and 0 < r < b; 

q is called the quotient and r is called the remainder. With m = 
10 • r^_i in Theorem 16.5, this yields 

10 • rk- 1 = bq + r where 0 < r < b. 

If we name q = dk and r = r^, then we obtain formula (2) in 
Theorem 16.5. For more details, see for example, [60, §3.5]. 

Example 4 

An expansion such as 

. 101001000100001000001000000100000001000000001000000000100 -• • 

represents an irrational number, since it cannot be a repeating 
decimal: we’ve arranged for arbitrarily long blocks of 0’s. □ 

Example 5 

We do not know the complete decimal expansions of \/2, \/3 and 
many other familiar irrational numbers, but we know that they 
cannot be repeating by virtue of the last theorem. □ 

Example 6 

We have claimed ir and e are irrational. These facts and many others 
are proved in a fascinating book by Ivan Niven [49]. 

(a) Here is a proof that 



is irrational. Assume e = | where a, b E N. Then both (6+l)!-e 
and (6 + 1)! • J, must be integers, so the difference 

oo 1 

(6+1)! £ * 
k=b +2 K ' 
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must be a positive integer. On the other hand, this last number 
is less than 

1 1 | 1 | _ bp2 _ 1 ^ , 

6 + 2 + (6 + 2) 2 + (6 + 2)3 + " ' “ l ~ r ; - < » 

a contradiction. 

(b) We will prove 7r 2 is irrational, from which the irrationality of 
7 r follows; see Exercise 16.10. 

The key to the proof that 7r 2 is irrational is the sequence of 
integrals I n = J'J sin xdx. Thus 

In = 

Claim 1. There is a sequence (Q n )^Lo °f polynomials with 
integer coefficients, of degree at most n, satisfying I n = Q n { tt 2 ) 
for all n. 


P n (x) sin x dx where P n (x) = 


(x(tt — x)) r 


n\ 


Proof. First, we obtain a recursive relation for I n \ see (3). 
We use integration by parts (Theorem 34.2) twice to show 

pTT /*7T 

I n = / P n (x) sin x dx = — / P”(x)smxdx for n > 1. 

Jo Jo 

(1) 

In fact, 

r 7T /* 7T 

/ Pn (x) sin xdx = [—Pn (tt) COs(7r) + P n (0) cos(0)] + / Pn (x) COS x dx 
Jo Jo 

/*7T 

= / P'n{x) COS xdx, 

Jo 

since P n {x) contains a factor of x{ir — x) which is 0 at both 7r 
and 0. Therefore 

/*7r 

I n = P' n {x)cosxdx 

Jo 

= [P'n^) Sin(TT) - P'ni °) sin ( 0 )] “ [ P n( x ) sin * dx 

Jo 

rn 

= — Pn(x) sin x dx, 
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and (1) holds. For n > 2, we have 

P n( X ) = -NTj-- 2x ) = Pn-l(x){lT - 2x), 

(n — lj! 

so, using this for n — 1 and the product rule, we have 

P"(x) = P n - 2 {x)(TT - 2x ) 2 + P n -x(x)(—2) 

= 7 T 2 P n _ 2 (x) + P n -2(x)(-4nx + 4x 2 ) - 2P n -i(x). 

Since 

P n -2{x){-4'Kx+4x 2 ) = = —4-P n _i(x)(n — 1), 

(n — 2j! 

we conclude 

P"{x) = TT 2 P n - 2 {x) - [4(n - 1) + 2]P n _i(z). 
Therefore 

P"(x) = 7r 2 P n - 2 (x) - (4n - 2)P n _i(x) for n > 2. (2) 

To prove Claim 1, note that Iq = 2 is clear. Using (1) and 
P"{x) = —2, we see that I\ = 4. And from (1) and (2), we see 
that 

In = -TT 2 I n - 2 + (4n - 2)/ n _i for n > 2. (3) 

Now Claim 1 holds by a simple induction argument, where 
Qo = 2, Qi = 4, and 

Qn(x) = -xQ n - 2 (x) + (4n - 2)Q n _i(x) for n > 2. 


Claim 2. it 2 is irrational. 


Proof. Suppose 7r 2 = a/b. Using Claim 1, we see that 
each b n I n = b n Q n (a/b ) is an integer. Since x(tt — x) takes its 
maximum at ir/2, we can write 


0 < b n I n = b n 


< b r ‘ 


(x(lT — X ))’ 


sin x dx 


n\ 


( 7T 7T \Tl 

[ - 2 ^dx = 


bn 2 

4 


■ 7 T. 


n! 


n ! 
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As noted in Exercise 9.15, the right-hand side converges to 0. 
So, for large n, the integer b n I n lies in the interval (0,1), a 
contradiction. 

This simplification of Ivan Niven’s famous short proof 
(1947) is due to Zhou and Markov [72], Zhou and Markov use a 
similar technique to prove tanr is irrational for nonzero ratio¬ 
nal r and cos r is irrational if r 2 is a nonzero rational. Compare 
with results in Niven’s book [49, Chap. 2], 

(c) It is even more difficult to prove n and e are not algebraic 
numbers; see Definition 2.1. These results are proved in Niven’s 
book [49, Theorems 2.12 and 9.11]. □ 


Example 7 

There is a famous number introduced by Euler over 200 years ago 
that arises in the study of the gamma function. It is known as Euler’s 
constant and is defined by 


7 = lim 

n—>oo 


E 

Lfc=l 


log e n 


Even though 


1 

lim > — = Too and lim log e n = +oo, 

n—7-oo ^ J fz n—>oo 

k= 1 


the limit defining 7 exists and is finite [Exercise 16.9]. In fact, 7 
is approximately 0.577216. The amazing fact is that no one knows 
whether 7 is rational or not. Most mathematicians believe 7 is irra¬ 
tional. This is because it is “easier” for a number to be irrational, 
since repeating decimal expansions are regular. The remark in Ex¬ 
ercise 16.8 hints at another reason it is easier for a number to be 
irrational. □ 


Exercises 

16.1 (a) Show 2.749 and 2.750 are both decimal expansions for ^. 

(b) Which of these expansions arises from the long division process 
described in 16.1? 
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16.2 Verify the claims in the first paragraph of the proof of Theorem 16.3. 

16.3 Suppose 22 a n and 2Z b n are convergent series of nonnegative num¬ 
bers. Show that if a n < b n for all n and if a n < b n for at least one n, 
then Y, a n <J2 b n- 

16.4 Write the following repeating decimals as rationals, i.e., as fractions 
of integers. 


(a) ,2_ 
(c) .02 
(e) .TO 


(b) ,02_ 
(d) 3. 14 
(f) .1492 


16.5 Find the decimal expansions of the following rational numbers. 


(a) 1/8 
(c) 2/3 
(e) 6/11 


(b) 1/16 
(d) 7/9 
(f) 22/7 


16.6 Find the decimal expansions of |, | and |. Note the 

interesting pattern. 

16.7 Is .1234567891011121314151617181920212223242526-•• rational? 

16.8 Let (s ra ) be a sequence of numbers in (0,1). Each s n has a decimal 
expansion 0 .d^d^d^ •••. For each n, let e n = 6 if d^ 7 ^ 6 and 
e n = 7 if d^ = 6 . Show .eie 2 e 3 • • • is the decimal expansion for 
some number y in (0,1) and y 7 ^ s n for all n. Remark: This shows 
the elements of (0,1) cannot be listed as a sequence. In set-theoretic 
parlance, (0,1) is “uncountable.” Since the set Qn (0,1) can be listed 
as a sequence, there are a lot of irrational numbers in ( 0 , 1 )! 



(a) Show ( 7 n ) is a decreasing sequence. Hint: Look at — 7 ^+ 1 . 

(b) Show 0 < 7 „ < 1 for all n. 

(c) Observe that 7 = lim„ 7„ exists and is finite. 

16.10 In Example 6 (b), we showed ir 2 is irrational. Use this to show n is 
irrational. What can you say about yTr and tfn? 7 r 4 ? 



Continuity 



CHAPTER 


Most of the calculus involves the study of continuous functions. 
In this chapter we study continuous and uniformly continuous 
functions. 


§17 Continuous Functions 

Recall that the salient features of a function / are: 

(a) The set on which / is defined, called the domain of f and 
written dom(/); 

(b) The assignment, rule or formula specifying the value f(x) of / 
at each x in dom(/). 

We will be concerned with functions / such that dom(/) C M 
and such that / is a real-valued function, i.e., f(x) £ M for all 
x G dom(/). Properly speaking, the symbol / represents the function 
while f(x) represents the value of the function at x. However, a func¬ 
tion is often given by specifying its values and without mentioning its 
domain. In this case, the domain is understood to be the natural do¬ 
main: the largest subset of M on which the function is a well defined 
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real-valued function. Thus “the function f(x) = 1” is shorthand for 
“the function / given by f(x) = 7 with natural domain {x E M : 
x ^ 0}.” Similarly, the natural domain of g(x) = \/4 — x 2 is [—2,2] 
and the natural domain of esc x = p4-p is the set of real numbers x 
not of the form mr, n£Z. 

In keeping with the approach in this book, we will define continu¬ 
ity in terms of sequences. We then show our definition is equivalent 
to the usual e-5 definition. 

17.1 Definition. 

Let / be a real-valued function whose domain is a subset of M. The 
function / is continuous at xq in dom(/) if, for every sequence (x n ) 
in dom(/) converging to xo, we have lim n f(x n ) = f(x o). If / is 
continuous at each point of a set S C dom(/), then / is said to 
be continuous on S. The function / is said to be continuous if it is 
continuous on dom(/). 

Our definition implies that the values f(x) are close to f(x o) 
when the values x are close to xq. The next theorem says this in 
another way. In fact, condition (1) of the next theorem is the e-5 
definition of continuity given in many calculus books. 

17.2 Theorem. 

Let f be a real-valued function whose domain is a subset o/M. Then 
f is continuous at xq in dom(/) if and only if 

for each e > 0 there exists 5 > 0 such that 
x E dom(/) and \x — xo\ < 5 imply \ f{x) — f(x o)| < e. 

(1) 

Proof 

Suppose (1) holds, and consider a sequence (x n ) in dom(/) such that 
lim x n = xq. We need to prove lirri f(x n ) = f(x o). Let e > 0. By (1), 
there exists 5 > 0 such that 

x E dom(/) and \x — xq\ < 5 imply | f(x) — /(a;o)| < e. 
Since lim x n = xo, there exists N so that 

n > N implies \x n — xq\ <5. 
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It follows that 


n> N implies | f(x n ) - /(x 0 )| < e. 

This proves lim f(x n ) = f(x o). 

Now assume / is continuous at xo, but (1) fails. Then there exists 
e > 0 so that the implication 

“x € dom(/) and \x — xo| < 8 imply |/(x) — /(xo)| < e” 
fails for each 6 > 0. In particular, the implication 

u x € dom(/) and \x — x$\ < — imply | /(x) — f(x o)| < e” 

n 

fails for each n £ N. So for each n € N there exists x n in dom(/) such 
that \x n —xo| < - and yet \f(xo) — f(x n )\ > e. Thus we have lim x n = 
xo, but we cannot have lim f(x n ) = f(x o) since |/(xo) — f(x n )\ > e 
for all n. This shows / cannot be continuous at xo, contrary to our 
assumption. ■ 

As the next example illustrates, it is sometimes easier to work 
with the sequential definition of continuity in Definition 17.1 than 
the e—8 property in Theorem 17.2. However, it is important to get 
comfortable with the e-S property, partly because the definition of 
uniform continuity is more closely related to the e—5 property than 
the sequential definition. 

Example 1 

Let /(x) = 2x 2 + 1 for x 6 1. Prove / is continuous on M by 

(a) Using the definition, 

(b) Using the e—5 property of Theorem 17.2. 

Solution 

(a) Suppose limx n = xq. Then we have 

lim / (x n ) = lim[2x 2 + 1] = 2[limx n ] 2 + 1 = 2 xq + 1 = /(x 0 ) 

where the second equality is an application of the limit 
Theorems 9.2-9.4. Hence / is continuous at each xo in M. 

(b) Let xo be in M and let e > 0. We want to show |/(x) —/(xo)| < e 
provided |x — xq| is sufficiently small, i.e., less than some <5. We 
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observe 

I f(x) - /Oo)| = \2x 2 + 1 - (2xq + 1)| = \2x 2 - 2 xq\ 

= 2\x — .To| ■ \x + Sol- 

We need to get a bound for |x + xo| that does not depend on x. 
We notice that if \x — xol < 1, say, then \x\ < |xo| + l and hence 
\x + xq \ < |x| + |x 0 | < 2|xo| + 1. Thus we have 

I/O) - /0o)| < 2|x - xo|(2|x 0 | + 1) 

provided \x — xq \ < 1. To arrange for 2\x — xo|(2|xo| + 1) < e, 
it suffices to have \x — xq \ < 2 (2|a;o|+i) anc ^ a ^ so 0 — x o| < 1- So 
we put 

1 J 2(2|xo| + l)J 

The work above shows \x — xo| <8 implies | f(x) — /0o)| < 
as desired. □ 

The reason that solution (a) in Example 1 is so much easier is 
that the careful analysis was done in proving the limit theorems in §9. 

Example 2 

Let /0) = ^ 2 sin(d) for x ^ 0 and /(0) = 0. The graph of / 
in Fig. 17.1 looks continuous. Prove / is continuous at 0. 

Solution 

Let e > 0. Clearly | f(x) — /(0)| = |/0)l < x 2 f° r ad x - Since we 
want this to be less than e, we set 8 = s/e. Then \x — 0| < <5 implies 
x 2 < 8 2 = e, so 

\x — 0| < 5 implies I/O) — /(0)| < e. 

Hence the e—5 property holds and / is continuous at 0. □ 

In Example 2 it would have been equally easy to show that if 
limx n = 0 then lim/O n ) = 0. The function / in Example 2 is also 
continuous at the other points of M; see Example 4. 

Example 3 

Let /0) = ) sin(do) for x / 0 and /(0) = 0. Show / is discontinuous, 
i.e., not continuous, at 0. 
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y 



FIGURE 17.1 


Solution 

It suffices for us to find a sequence (x n ) converging to 0 such 
that f(x n ) does not converge to /(0) = 0. So we will arrange 
for -^-sin(-V) = — where x n —*■ 0. Thus we want sin(-^-) = 1, 

X n v X n ' X n v X n ' 

= 2vr n + §, x\ = or Xn = s /-^ n +^ ' Tlien lim Xn = 0 while 

lint f(x n ) = lim X- = +oo. □ 

N 7 x n 

Let / be a real-valued function. For k in R, kf signifies the func¬ 
tion defined by ( kf)(x ) = kf(x ) for x £ dom(/). Also |/| is the 
function defined by |/|(x) = \f(x)\ for x £ dom(/). Thus if / is given 
by f(x) = \fx — 4 for x > 0, then 3/ is given by (3 f)(x) = 3y/x — 12 
for x > 0, and |/| is given by |/|(x) = \y/x — 4| for x > 0. Here is an 
easy theorem. 
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17.3 Theorem. 

Let f be a real-valued function with dom (/) CM. If f is continuous 
at xq in dom(/), then \f\ and kf, k e M, are continuous at xq. 

Proof 

Consider a sequence (x n ) in dom(/) converging to xo. Since / is 
continuous at xq, we have lim f(x n ) = f{x o). Theorem 9.2 shows 
lim kf{x n ) = kf(xo). This proves kf is continuous at xo. 

To prove |/| is continuous at xo, we need to prove lim \f(x n )\ = 
\f(xo)\. This follows from the inequality 

ll/(®n)| - l/(®o)|| < I f(x n ) - /(x 0 )|; ( 1 ) 

see Exercise 3.5. [In detail, consider e > 0. Since lim f(x n ) = f(x o), 
there exists N such that n > N implies | f(x n ) — f(x o)| < e. So 

by (i), 

n> N implies \\f(x n )\ - |/(x 0 )|| < e; 
thus lim \f(x n )\ = |/(x 0 )|.] ■ 

We remind readers that if / and g are real-valued functions, then 
we can combine / and g to obtain new functions: 

(/ + g)(x) = f(x) + g{x)\ fg(x) = f(x)g(x)] 

(f/g)(x) = §yy; g ° fix) = g(f(x))] 

ma x(f,g)(x) = ma x{f(x),g{x)}; min (f,g){x) = nrin {f(x),g{x)j 

The function go f is called the composition of g and f. Each of these 
new functions is defined exactly where they make sense. Thus the 
domains of f + g, fg, max(/, g) and min (f,g) are dom(/) fl dom(g), 
the domain of f /g is the set dom(/) n {x € dom(^) : g(x) 7 ^ 0 }, 
and the domain of g o f is {x E dom(/) : f(x) E dom(< 7 )}. Note 
f + g = g + f and fg = gf but that in general f o g ^ go f. 

These new functions are continuous if / and g are continuous. 

17.4 Theorem. 

Let f and g be real-valued functions that are continuous at xq in M. 
Then 

(i) / + g is continuous at xq; 

(ii) fg is continuous at xq; 

(iii) f /g is continuous at xq if g{x 0 ) 7 ^ 0 . 
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Proof 

We are given that xo € dom(/) fl dom(g). Let ( x n ) be a sequence in 
dom(/) ndom(g) converging to xo- Then we have lim/(x n ) = /(xo) 
and limg(x n ) = g(x o). Theorem 9.3 shows 

lim (f + g){x n ) = lim [f(x n ) + g(x n )] = lirn f(x n ) + limy(x n ) 

= fix 0 ) + g(x 0 ) = (f + g)(x 0 ), 


so / + g is continuous at xq. Likewise, Theorem 9.4 implies fg is 
continuous at xq. 

To handle f/g we assume g{x o) ^ 0 and consider a sequence 
(x n ) in dom(/) n {x E dom(< 7 ) : g(x) ^ 0} converging to xq. Then 
Theorem 9.6 shows 


lim 



(x n ) = lim 


f{Xn) 

g(x n ) 


fix o) 
gix o 



so f/g is continuous at xq. 


17.5 Theorem. 

If f is continuous at xq and g is continuous at fix o), then the 
composite function g o f is continuous at xo . 

Proof 

We are given that xq 6 dom(/) and f{x o) E dom( 5 r). Let (x n ) be a 
sequence in {x E dom(/) : fix) E dom(< 7 )} converging to xq. Since / 
is continuous at xo, we have lim f(x n ) = fix o). Since the sequence 
ifi x n )) converges to /(xo) and g is continuous at /(xo), we also have 
limg(/(x n )) = gifix 0 )); that is, lim go/(x n ) = gof(x 0 ). Hence gof 
is continuous at xq. ■ 


Example 4 

For this example, let us accept as known that polynomial functions 
and the functions sinx, cosx and e x are continuous on R. Then 
4e x and | sinx| are continuous on R by Theorem 17.3. The function 
sinx + 4e x + x 3 is continuous on R by (i) of Theorem 17.4. The 
function x 4 sinx is continuous on R by (ii) of Theorem 17.4, and 
(iii) of Theorem 17.4 shows tanx = is continuous wherever 
cosx ^4 0, i.e., at all x not of the form mr + n E Z. Theorem 17.5 
tells us e smx and cos(e x ) are continuous on R; for example, cos^ 1 ) = 
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g o f(x) where f(x) = e x and g(x) = cosx. Several applications of 
Theorems 17.3-17.5 will show x 2 sin(^) and ^ sin(T-) are continuous 
at all nonzero x in M. □ 

Example 5 

Let / and g be continuous at xq in R. Prove max(/, g) is continuous 
at xq . □ 

Solution 

We could prove this using Definition 17.1 or the e—8 condition in 
Theorem 17.2. However, we illustrate a useful technique by reducing 
the problem to results we have already established. First, observe 

max(/, g) = i(/ + g) + i|/ - g\, 

which shows that the function max(/, g) is a combination of func¬ 
tions to which our theorems apply. This equation holds because 
max{a, b} = \{a + b) + ^\a — b\ is true for all a, b E R, a fact which 
is easily checked by considering the cases a > b and a < b. By The¬ 
orem 17.4(i), f + g and f — g are continuous at xo- Hence \f — g\ 
is continuous at xq by Theorem 17.3. Then ^(/ + g) and / — g\ 
are continuous at xq by Theorem 17.3, and another application of 
Theorem 17.4(i) shows max(/, g) is continuous at xq. □ 


Exercises 

17.1 Let f{x) = \J\ — x for x < 4 and g{x) = x 2 for all x € R. 

(a) Give the domains of / + g, fg, fog and go f. 

(b) Find the values /o 5 ( 0 ), 30/(0), f o g{ 1 ), 30/(1), f o g( 2 ) and 
5 °/( 2). 

(c) Are the functions fog and 30/ equal? 

(d) Are / o g( 3 ) and 3 o /( 3 ) meaningful? 

17.2 Let fix ) = 4 for x > 0 , fix) = 0 for x < 0 , and gix) = x 2 for all x. 
Thus dom(/) = dom(3) = R. 

(a) Determine the following functions: / + 3, fg, f o 3, 30/. Be 
sure to specify their domains. 

(b) Which of the functions /, 3, f + g, fg, f 03, go f is continuous? 
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17.3 Accept on faith that the following familiar functions are continuous 
on their domains: sin a:, cos 2 , e x , 2 X . log e x for x > 0, x p for x > 0 
\p any real number]. Use these facts and theorems in this section to 
prove the following functions are also continuous. 


( a ) 

log e (l + cos 4 

x) 

(b) 

[sin 2 x + cos 6 

xY 

( c ) 

2 x 2 


(d) 

8 * 


(e) 

tan a; for x ^ 

odd multiple of 

(f) 

xsin(i) for x ^ 0 

(g) 

x 2 sin(i) for 

r/0 

(h) 

- sin(Aj-) for 

X x X* ' 



17.4 Prove the function yfx is continuous on its domain [0, oo). Hint-. 
Apply Example 5 in §8. 

17.5 (a) Prove that if m € N, then the function f(x) = x m is continuous 

on R. 

(b) Prove every polynomial function p(x) = ao + a\X + • • • + a n x n 
is continuous on R. 

17.6 A rational function is a function / of the form pjq where p and q are 
polynomial functions. The domain of / is {x £ R : q(x) Y 0}. Prove 
every rational function is continuous. Hint: Use Exercise 17.5. 

17.7 (a) Observe that if k £ R, then the function g{x) = kx is continuous 

by Exercise 17.5. 

(b) Prove |x| is a continuous function on R. 

(c) Use (a) and (b) and Theorem 17.5 to give another proof of 
Theorem 17.3. 

17.8 Let / and g be real-valued functions. 

(a) Show min(/,p) = \{f + g) - \\f - g\. 

(b) Show min(/, g) = - max(-/, - g). 

(c) Use (a) or (b) to prove that if / and g are continuous at xq in 
R, then min (f,g) is continuous at Xq. 
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17.9 Prove each of the following functions in continuous at xo by verifying 
the e-S property of Theorem 17.2. 

(a) f(x) = x 2 , x 0 = 2 ; 

(b) f(x) = y/x, x 0 = 0 ; 

(c) f(x) = xsin(b) for x ^ 0 and /( 0 ) = 0 , Xo = 0 ; 

(d) g(x) = x 3 , xo arbitrary. 

Hint for (d): x 3 — Xq = (x — Xo)(x 2 + Xox + Xq). 

17.10 Prove the following functions are discontinuous at the indicated 
points. You may use either Definition 17.1 or the e—S property in 
Theorem 17.2. 

(a) /(x) = 1 for x > 0 and /(x) = 0 for x < 0 , Xo = 0 ; 

(b) g(x) = sin(i) for x ^ 0 and g( 0 ) = 0 , Xo = 0 ; 

(c) sgn(x) = —1 for x < 0 , sgn(x) = 1 for x > 0 , and sgn( 0 ) = 0 , 
Xo = 0. The function sgn is called the signum function; note 
sgn(x) = !§y for x ± 0 - 

17.11 Let / be a real-valued function with dom(/) C R. Prove / is con¬ 
tinuous at Xo if and only if, for every monotonic sequence (x n ) in 
dom(/) converging to Xo, we have lim/(x n ) = /(xo). Hint: Don’t 
forget Theorem 11.4. 

17.12 (a) Let / be a continuous real-valued function with domain (a, b). 

Show that if f{r) = 0 for each rational number r in (a, b), then 
/(x) = 0 for all x £ (a, b). 

(b) Let / and g be continuous real-valued functions on (o, b) such 
that /(r) = g{r) for each rational number r in ( a,b ). Prove 
/(x) = g(x) for all x £ (a,b). Hint: Use part (a). 

17.13 (a) Let /(x) = 1 for rational numbers x and /(x) = 0 for irrational 

numbers. Show / is discontinuous at every x in R. 

(b) Let h(x) = x for rational numbers x and h{x) = 0 for irrational 
numbers. Show h is continuous at x = 0 and at no other point. 

17.14 For each nonzero rational number x, write x as | where p,q are 
integers with no common factors and q > 0, and then define /(x) = 
~. Also define /(0) = 1 and /(x) = 0 for all x £ R\Q. Thus /(x) = 1 
for each integer, /(|) = /(—|) = /(|) = • • • = |, etc. Show / is 
continuous at each point of R \ Q and discontinuous at each point 
of Q. 
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17.15 Let / be a real-valued function whose domain is a subset of R. Show 
/ is continuous at Xo in dom(/) if and only if, for every sequence 
(x n ) in dom(/) \ {xo} converging to x’o, we have lim/(x„) = f(x o). 

17.16 The postage-stamp function P is defined by P(x) = A for 0 < x < 1 
and P(x) = A + Bn for n < x < n + 1. The definition of P means 
that P takes the value A on the interval [0,1), the value A + B on 
the interval [1, 2), the value A + 2 B on the interval [2,3), etc. Here 
A is postage needed for the first ounce, and B is the postage needed 
for each additional ounce. Show P is discontinuous at every positive 
integer. Because postage rates tend to increase over time, A and B 
are actually functions. 


§18 Properties of Continuous Functions 

A real-valued function / is said to be bounded if {/(x) : x G dom(/)} 
is a bounded set, i.e., if there exists a real number M such that 
|/(x)| < M for all x G dom(/). 

18.1 Theorem. 

Let f be a continuous real-valued function on a closed interval [a, b]. 
Then f is a bounded function. Moreover, f assumes its maximum 
and minimum values on [a, b\; that is, there exist xo>2/o in- [a, b] such 
that f(x 0 ) < f(x) < f(y 0 ) for all x G [a, b]. 

Proof 

Assume / is not bounded on [a, b\. Then to each n G N there 
corresponds an x n G [a, b\ such that \f(x n )\ > n. By the Bolzano- 
Weierstrass Theorem 11.5, (x n ) has a subsequence (x nk ) that 
converges to some real number xq. The number xo also must be¬ 
long to the closed interval [a, b], as noted in Exercise 8.9. Since / is 
continuous at xq, we have lim^oo f{x nk ) = f(x o), but we also have 
Hindoo \f(x nk )\ = +oo, which is a contradiction. It follows that / is 
bounded. 

Now let M = sup {f(x) : x G [a, £>]}; M is finite by the preced¬ 
ing paragraph. For each n G N there exists y n G [a, b] such that 
M — - < f(y n ) < M. Hence we have lirri f(y n ) = M. By the 
Bolzano-Weierstrass theorem, there is a subsequence (y nfc ) of (y n ) 
converging to a limit yo hr [«, b]. Since / is continuous at yo, we 
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have f(y 0 ) = lim^^ f(y nk ). Since (f(y nk ))ke N is a subsequence of 
(f(yn))ne N, Theorem 11.3 shows lim fc _> 0 a f(y nk ) = lim, woo f(y n ) = 
M and therefore f(yo) = M. Thus / assumes its maximum at y o- 

The last paragraph applies to the function —/, so — / assumes 
its maximum at some xq E [a, b ]. It follows easily that / assumes its 
minimum at xq\ see Exercise 18.1. ■ 

Theorem 18.1 is used all the time, at least implicitly, in solv¬ 
ing maximum-minimum problems in calculus because it is taken for 
granted that the problems have solutions, namely that a continuous 
function on a closed interval actually takes on a maximum and a 
minimum. If the domain is not a closed interval, one needs to be 
careful; see Exercise 18.3. 

Theorem 18.1 is false if the closed interval [a, b\ is replaced by an 
open interval. For example, f(x) = - is continuous but unbounded 
on (0,1). The function x 2 is continuous and bounded on (—1,1), but 
it does not have a maximum value on (—1,1). 

18.2 Intermediate Value Theorem. 

If f is a continuous real-valued, function on an interval I, then f has 
the intermediate value property on I: Whenever a,b E I, a < b and y 
lies between f(a) and f(b ) [i.e., f(a) < y < f(b) or f(b) < y < /(a)], 
there exists at least one x in (a, 6) such that f(x) = y. 


Proof 

We assume f(a) < y < /(6); the other case is similar. Let S = 
{x E [a, b] : f{x) < y}; see Fig. 18.1. Since a belongs to S, the set 
S is nonempty, so xq = sup S' represents a number in [a,b\. For each 
n E N, xo — ^ is not an upper bound for S, so there exists s n E S 
such that xo — - < s n < xq. Thus lims n = xq and, since f(s n ) < y 
for all n, we have 

f(xo) = lim/(s n ) < y. (1) 

Let t n = min{6, xo + -;}• Since xo < t n < xo + we have lirri t n = xo- 
Each t n belongs to [a, b] but not to S, so f(t n ) > y for all n. Therefore 
we have 

f(x 0 ) = lim / (t n ) > y; 

this and (1) imply f(x o) = y. ■ 
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18.3 Corollary. 

If f is a continuous real-valued function on an interval I, then the 
set f(I ) = {f(x) : x E 1} is also an interval or a single point. 

Proof 

The set J = /(/) has the property: 

yo,yi<EJ and y 0 < y < y l imply y E J. (1) 

If inf J < sup J, then such a set J will be an interval. In fact, we will 
show 

inf J < y < sup J implies y E J, (2) 

so J is an interval with endpoints inf J and sup J; inf J and sup J 
may or may not belong to J and they may or may not be finite. 

To prove (2) from (1), consider inf J < y < supJ. Then there 
exist ?/o, 2/i in J so that yo < y < yi- Thus y E J by (1). ■ 

Example 1 

Let / be a continuous function mapping [0,1] into [0,1]. In other 
words, dom(/) = [0,1] and f(x) E [0,1] for all x € [0,1]. Show / has 
a fixed point, i.e., a point xq E [0,1] such that f(x o) = xq\ xq is left 
“fixed” by /. □ 
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Solution 

The graph of / lies in the unit square; see Fig. 18.2. Our assertion 
is equivalent to the assertion that the graph of / crosses the y = x 
line, which is almost obvious. 

A rigorous proof involves a little trick. Consider g(x) = f(x) — x 
which is also a continuous function on [0,1]. Since g{ 0) = /(0) — 0 = 
/(0) > 0 and g( 1) = /(1) — 1 < 1 — 1 = 0, the Intermediate Value 
theorem shows g(x o) = 0 for some xq 6 [0,1]. Then obviously we 
have f(x o) = xq. □ 

Example 2 

Show that if y > 0 and m £ N, then y has a positive mth root. □ 

Solution 

The function f(x) = x m is continuous [Exercise 17.5]. There exists 
6 > 0 so that y < b m \ in fact, if y < 1 let b = 1 and if y > 1 let 
b = y. Thus /(0) < y < f(b) and the Intermediate Value theorem 
implies f(x) = y for some x in (0,6]. So y = x m and x is an mth 
root of y. □ 

Let us analyze the function f(x) = x m in Example 2 more closely. 
It is a strictly increasing function on [0, oo): 

0 < x\ < X 2 implies xf' < x™ . 
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Therefore / is one-to-one and each nonnegative y has exactly one 
nonnegative mth root. This assures us that the notation y 1 ! rn is 
unambiguous. In fact, f^ 1 (y) = y is the inverse function of / 
since / _1 o f(x) = x for x E dom(/) and / o f~ l (y ) = y for y E 
dom(/ _1 ). Since f(x) = x m is continuous, the function / _1 (y) = 
yi/m j g continuous on [0, oo) by the next theorem. Note that for 
m = 2 this result appears in Exercise 17.4. 

18.4 Theorem. 

Let f be a continuous strictly increasing function on some interval 
I. Then f(I ) is an interval J by Corollary 18.3 and / -1 represents 
a function with domain J. The function / -1 is a continuous strictly 
increasing function on J. 

Proof 

The function / -1 is easily shown to be strictly increasing. Since / -1 
maps J onto /, the next theorem shows / _1 is continuous. ■ 

18.5 Theorem. 

Let g be a strictly increasing function on an interval J such that g(J) 
is an interval I. Then g is continuous on J. 

Proof 

Consider xo in J. We assume xq is not an endpoint of J; tiny changes 
in the proof are needed otherwise. Then g(x o) is not an endpoint of 
/, so there exists eo > 0 such that (g(x o) — eo,g(xo) + eo) 7 d. 

Let e > 0. Since we only need to verify the e~S property of The¬ 
orem 17.2 for small e, we may assume e < eo- Then there exist 
x\,X 2 E J such that g(x i) = g(x o) — e and g(x 2 ) = g(x 0 ) + e. 
Clearly we have x\ < xq < X 2 ■ Also, if x\ < x < X 2 , then 
g(x 1 ) < g(x) < g(x 2 ), hence g(x 0 ) — e < g(x) < g(x 0 ) + e, and hence 
| g(x) — g(x o)| < e. Now if we put 6 = min{x 2 — xo,xq — xi}, then 
\x — xo\ < 6 implies x\ < x < X 2 and hence | g(x) — g , (xo)| < e. ■ 

Theorem 18.5 provides a partial converse to the Intermediate 
Value theorem, since it tells us that a strictly increasing func¬ 
tion with the intermediate value property is continuous. However, 
Exercise 18.12 shows that a function can have the intermediate value 
property without being continuous. 
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18.6 Theorem. 

Let f be a one-to-one continuous function on an interval I. Then 
f is strictly increasing [x\ < X 2 implies f(x i) < f{x 2 )] or strictly 
decreasing [xi < x '2 implies f(x 1 ) > f(x 2 )]. 

Proof 

First we show 

if a < b < c in /, then /(b) lies between /(a) and /(c). (1) 

If not, then /(b) > max{/(a), /(c)}, say. Select y so that f(b) > y > 
max{/(a),/(c)}. By the Intermediate Value Theorem 18.2 applied 
to [a, b\ and to [6, c], there exist x\ € (a, b ) and X 2 € (6, c) such that 
f(x 1 ) = f(x 2 ) = y. This contradicts the one-to-one property of /. 

Now select any a 0 < bo in I and suppose, say, that /(ao) < /(bo). 
We will show / is strictly increasing on I. By (1) we have 

f(x) < /(ao) for x < ao [since x < ao < bo], 

/(ao) < f(x) < /(bo) for a 0 < x < b 0 , 

/(bo) < /(x) for x > bo [since ao < bo < x\. 

In particular, 

f(x) < f (a 0 ) for all x < a 0 , (2) 

/(ao) < f{x) for all x > a 0 . (3) 

Consider any x'i < X 2 in I. If x\ < ao < X 2 , then f{x 1 ) < /(.T 2 ) 

by (2) and (3). If x x < x 2 < a 0 , then f(xi) < f(a 0 ) by (2), so by (1) 

we have f(x 1 ) < f(x 2 ). Finally, if ao < x\ < X 2 , then /(ao) < f(x 2 ), 
so that f{x 1 ) < f(x 2 ). ■ 


Exercises 

18.1 Let / be as in Theorem 18.1. Show that if —/ assumes its maximum 
at Xo € [a, 6 ], then / assumes its minimum at xq- 

18.2 Reread the proof of Theorem 18.1 with [a, b] replaced by (a, b). Where 
does it break down? Discuss. 


18.3 Use calculus to find the maximum and minimum of f(x) = x 3 — 6x 2 + 
9x + 1 on [0, 5). 
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18.4 Let SCI and suppose there exists a sequence (x n ) in S converging 
to a number xo £ S. Show there exists an unbounded continuous 
function on S. 

18.5 (a) Let / and g be continuous functions on [a, 6 ] such that /(a) > 

g(a) and f(b) < gib). Prove f(x o) = g(x o) for at least one Xo in 
[a,b\. 

(b) Show Example 1 can be viewed as a special case of part (a). 

18.6 Prove x = cos a: for some x in (0, |). 

18.7 Prove xe x = 2 for some x in (0,1). 

18.8 Suppose / is a real-valued continuous function on R and f(a)f(b) < 0 
for some a,b £ R. Prove there exists x between a and b such that 

fix) = 0 . 

18.9 Prove that a polynomial function / of odd degree has at least one 
real root. Hint: It may help to consider first the case of a cubic, i.e., 
f{x) = ao + a\X + aix 1 + 03 a ; 3 where <23 7 ^ 0. 

18.10 Suppose / is continuous on [0,2] and /(0) = /(2). Prove there exist 
x,y in [0,2] such that \y — x\ = 1 and /( x) = f(y). Hint: Consider 
g{x) = f(x + 1 ) - fix) on [ 0 , 1 ], 

18.11 (a) Show that if / is strictly increasing on an interval /, then —/ is 

strictly decreasing on I. 

(b) State and prove Theorems 18.4 and 18.5 for strictly decreasing 
functions. 

18.12 Let f(x) = sin(i) for x 7 ^ 0 and let /(0) = 0. 

(a) Observe that / is discontinuous at 0 by Exercise 17.10(b). 

(b) Show / has the intermediate value property on R. 


§19 Uniform Continuity 

Let / be a real-valued function whose domain is a subset of M. The¬ 
orem 17.2 tells us that / is continuous on a set S C dom(/) if and 
only if 

for each xq 6 S and e > 0 there is <5 > 0 so that 
x £ dom if) and \x — xo\ < 8 imply | fix) — /(^o)| < e - 

The choice of 5 depends on e > 0 and on the point xq in S. 
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Example 1 

We verify (*) for the function f(x) = on (0,oo). Let xo > 0 and 
e > 0. We need to show | f(x) — f(x o)| < e for \x — xq\ sufficiently 
small. Note that 


fix) - f{x 0 ) 


1 1 

™2 ™ 2 

Jj <L/ Q 


rr 2 _ ~2 
Q Jb 

™2™2 
<X/ iL Q 


Oo - x)(x 0 + x) 

^. 2^.2 
.X/ «-L Q 


(1) 


li\x — xq\ < ff-, then we have |tc| > |x| < ^ and \xq + x\ < 

These observations and (1) show that if \x — xq | < ^, then 


I fix) - /(x 0 )| < 


ko - x\ ■ ^ 

(f) 2 ^ 


10|xo — a; | 


Xn 


Thus if we set <5 = rnin{^. ^}, then 


x — xq | < 6 implies | fix) — /(a;o)| < e. 


This establishes (*) for / on (0, oo). Note that 8 depends on both e 
and xq. Even if e is fixed, 8 gets small when xq is small. This shows 
that our choice of 8 definitely depends on xo as well as e, though this 
may be because we obtained 8 via sloppy estimates. As a matter of 
fact, in this case 8 must depend on xo as well as e; see Example 3. 
Figure 19.1 shows how a fixed e requires smaller and smaller 8 as xq 
approaches 0. [In the figure, 8\ signifies a 8 that works for x\ and e, 
82 signifies a 8 that works for X 2 and e, etc.] □ 


It turns out to be very useful to know when the 8 in condition 
(*) can be chosen to depend only on e > 0 and S, so that 8 does 
not depend on the particular point xq. Such functions are said to 
be uniformly continuous on S. In the definition, the points x and xq 
play a symmetric role, so we will call them x and y. 

19.1 Definition. 

Let / be a real-valued function defined on a set SCI. Then / is 
uniformly continuous on S if 

for each e > 0 there exists <5 > 0 such that , . 

x,y € S and \x - y\ < 8 imply | fix) - f(y)\ < e. 

We will say / is uniformly continuous if / is uniformly continuous 
on dom(/). 
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FIGURE 19.1 


Note that if a function is uniformly continuous on its domain, 
then it is continuous on its domain. This should be obvious; if it isn’t, 
Theorem 17.2 and Definition 19.1 should be carefully scrutinized. 
Note also that uniform continuity is a property concerning a function 
and a set [on which it is defined]. It makes no sense to speak of a 
function being uniformly continuous at each point. 

Example 2 

We show f(x) = \ is uniformly continuous on any set of the form 
[a, 00 ) where a > 0. Here a is fixed. Let e > 0. We need to show there 
exists 6 > 0 such that 

x>a, y > a and \x - y\ < 6 imply \f(x) - f(y)\ < e. (1) 
As in formula (1) of Example 1, we have 

{y-x)(y + x) 


f(x) - f(y) 


x 2y2 
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If we can show is bounded on [a, oo) by a constant M , then we 
will take 5 = jj. But we have 

y + x 1 1 1 1 2 

x 2 ?/ 2 x 2 y x?/ 2 — a 3 a 3 a 3 ’ 

3 

so we set <5 = 4=4. It is now straightforward to verify (1). In fact, 
x > a, y > a and |x — y\ < 5 imply 


\f{x)~ f{y)\ 


\y-x\(y + x)\ ( 1 J_\ < 25 

x 2 y 2 \x 2 y xy 2 ) ~ a 3 


We have shown / is uniformly continuous on [a, oo) since 5 depends 
only on e and the set [a, oo). □ 


Example 3 

The function /(x) = is not uniformly continuous on the set (0, oo) 
or even on the set (0,1). 

We will prove this by directly violating the definition of uni¬ 
form continuity. The squeamish reader may skip this demonstration 
and wait for the easy proof in Example 6. We will show (1) in 
Definition 19.1 fails for e = 1; that is 


for each 5 > 0 there exist x, y in (0,1) such that 
\x-y\ <5 and yet |/(x) - f(y)\ > 1. 


( 1 ) 


[Actually, for this function, (1) in Definition 19.1 fails for all e > 0.] 
To show (1) it suffices to take y = x + f and arrange for 


/ 0 ) - / 



> 1 . 


(2) 


[The motivation for this maneuver is to go from two variables, x 
and y, in (1) to one variable, x, in (2).] By (1) in Example 1, (2) is 
equivalent to 


(x + | - x)(x + | + x) _ 8{2x + f) 
x 2 (x + |) 2 2x 2 (x + f ) 2 


(3) 


It suffices to prove (1) for 5 < To apply (3), let us try x 
no particular reason. Then 


5(25 + |) 5<5 2 /2 5 5 _ 20 

25 2 (5 + |) 2 “ 9<5 4 /2 ~ 95 2 > 9(Jj^ " ~9 


5 for 
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We were lucky! To summarize, we have shown that if 0 < 6 < then 
| f(6) — f(S + |)| > 1, so (1) holds with x = 5 and y = 8 + □ 

Example 4 

Is the function f(x) = x 2 uniformly continuous on [—7, 7]? To see if it 
is, consider e > 0. Note that \f{x) — f(y)\ = \x 2 — y 2 \ = \x-y\-\x+y\. 
Since \x + y\ < 14 for x, y in [—7, 7], we have 

f{y)\<U\x-y\ for x,y€[- 7,7]. 

Thus if 8 = jg, then 

x,ye[- 7,7] and \x - y\ < 8 imply \f(x)-f{y)\<e. 

We have shown that / is uniformly continuous on [—7, 7]. A similar 
proof would work for f(x) = x 2 on any closed interval. How¬ 
ever, these results are not accidents as the next important theorem 
shows. □ 

19.2 Theorem. 

If f is continuous on a closed interval [a, 6], then f is uniformly 
continuous on [a, 6]. 

Proof 

Assume / is not uniformly continuous on [a, b\. Then there exists 
e > 0 such that for each 8 > 0 the implication 

“\x — y\ <5 implies | f(x) - f(y)\ < e” 

fails. That is, for each <5 > 0 there exist x, y G [a, b] such that \x—y\ < 
5 and yet | f(x) — f(y)\ > e. Thus for each n 6 N there exist x n ,y n 
in [a,b\ such that \x n - y n \ < £ and yet \f{x n ) - f(y n )\ > e. By 
the Bolzano-Weierstrass Theorem 11.5, a subsequence (x nk ) of (x n ) 
converges. Moreover, if xq = Yim.^ 00 x nk ^ then xq belongs to [a, 6]; 
see Exercise 8.9. Clearly we also have xq = limfc_>. 0O y nk . Since / is 
continuous at xo, we have 

f(x 0 ) = lim f(x nk ) = lim f(y nk ), 

K —^oo k—> oo 

SO 

lim [f{x nk ) - f(y nk )] = 0. 

K—> OO 

Since | f(x nk ) — f{y nk ) I > e for all fc, we have a contradiction. We 
conclude / is uniformly continuous on [a, b\. ■ 
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The preceding proof used only two properties of [a, b\: 

(a) Boundedness, so the Bolzano-Weierstrass theorem applies; 

(b) A convergent sequence in [a, 6] converges to an element in [a, b\. 

As noted prior to Theorem 11.9, sets with property (b) are called 
closed sets. Hence Theorem 19.2 has the following generalization. If 
f is continuous on a closed and bounded set S, then f is uniformly 
continuous on S. See also Theorems 21.4 and 13.12 that appear in 
enrichment sections. 

Example 5 

In view of Theorem 19.2, the following functions are uniformly 
continuous on the indicated sets: x 73 on [—13,13], \fx on [0,400], 


x 1 ' sin(e x ) — e 4a: cos2x on [—87 t,87t], and ^ on [|,44], 


□ 


19.3 Discussion. 

Example 5 illustrates the power of Theorem 19.2, but it still may 
not be clear why uniform continuity is worth studying. One of the 
important applications of uniform continuity concerns the integrabil- 
ity of continuous functions on closed intervals. To see the relevance 
of uniform continuity, consider a continuous nonnegative real-valued 
function / on [0,1]. For n 6 N and i = 0,1, 2,..., n — 1, let 



Then the sum of the areas of the rectangles in Fig. 19.2a equals 


rt .— 1 



2=0 

and the sum of the areas of the rectangles in Fig. 19.2b equals 

n — 1 



The function / would turn out to be Riemann integrable provided 
the numbers U n and L n are close together for large n, i.e., if 


lim (U n - L n ) = 0; 


n—>■ oo 


(i) 
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see Exercise 32.6. Moreover, we would have fg f(x)dx = lim U n = 
limL^. Relation (1) may appear obvious from Fig. 19.2, but uniform 
continuity is needed to prove it. First note 

^ n— 1 

0 ^ Un L n = \ ^(Min ^z,n) 

n ' 
i =0 

for all n. Let e > 0. By Theorem 19.2, / is uniformly continuous on 
[0,1], so there exists <5 > 0 such that 

x,y€[ 0,1] and \x - y\ < 5 imply \f(x) - f{y)\ < e. (2) 

Select N so that ^ < 5. Consider n > TV; for i = 0,1,2,..., n — 1, 
Theorem 18.1 shows there exist Xi,yt in [^, satisfying f{x{) = 
m^ n and /(^) = M,; n . Since |xj - y*| < i < ^ < <5, (2) shows 

M i>n - m it n = f(yi) - f(xi ) < e, 


so 


0 < — L n 


^ ^ 

~ ^ ^ (Mj,n 

n i=0 


< 


1 

n 


n— 1 


2=0 


This proves (1) as desired. 


e. 


□ 


The next two theorems show uniformly continuous functions have 
nice properties. 
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19.4 Theorem. 

If f is uniformly continuous on a set S and (s n ) is a Cauchy sequence 
in S, then ( f{s n )) is a Cauchy sequence. 

Proof 

Let (s n ) be a Cauchy sequence in S and let e > 0. Since / is uniformly 
continuous on S, there exists <5 > 0 so that 

x,y 6 S and \x - y\ < 8 imply \f{x)-f(y)\<e. (1) 

Since (s n ) is a Cauchy sequence, there exists N so that 

m,n> N implies |s n — s m | < 6. 

From (1) we see that 

m,n> N implies | f(s n ) - f(s m )\ < e. 

This proves ( f{s n )) is also a Cauchy sequence. ■ 

Example 6 

We show f(x) = \ is not uniformly continuous on (0,1). Let s n = ^ 
for n £ N. Then (s n ) is obviously a Cauchy sequence in (0,1). Since 
f(s n ) = n 2 , ( f(s n )) is not a Cauchy sequence. Therefore / cannot 
be uniformly continuous on (0,1) by Theorem 19.4. □ 

The next theorem involves extensions of functions. We say a 
function / is an extension of a function f if 

dom(/) C dom(/) and f(x) = f(x) for all x € dom(/). 

Example 7 

Let f(x) = xsin(^) for x 6 (0, -]. The function defined by 

tt \ / ®sin(i) for 0 < x < \ 

f(x) = { 0 for x = 0 

is an extension of /. Note that dom(/) = (0, and dom(/) = [0, ^]. 
In this case, / is a continuous extension of /. See Fig. 19.3 as well as 
Exercises 17.3(f) and 17.9(c). □ 
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FIGURE 19.3 

Example 8 

Let g{x) = sin(-) for x G (0, ^]. The function g can be extended 
to a function g with domain [0, - in many ways, but g will not be 
continuous. See Fig. 19.4. □ 


The function / in Example 7 is uniformly continuous [since / 
is], and / extends to a continuous function on the closed interval. 
The function g in Example 8 does not extend to a continuous func¬ 
tion on the closed interval, and it turns out that g is not uniformly 
continuous. These examples illustrate the next theorem. 
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19.5 Theorem. 

A real-valued function f on (a, b) is uniformly continuous on (a, b ) 
if and only if it can be extended to a continuous function f on [a, b\. 

Proof 

First suppose / can be extended to a continuous function / on [a, b]. 
Then / is uniformly continuous on [a, b] by Theorem 19.2, so clearly 
/ is uniformly continuous on (a, b). 

Suppose now that / is uniformly continuous on (a, b). We need to 
define /(a) and f(b) so that the extended function will be continuous. 












§19. Uniform Continuity ^49 


It suffices for us to deal with /(a). We make two claims: 

if (s n ) is a sequence in (a, b) converging 
to a, then (/(s n )) converges, 

and 

if (s n ) and (t n ) are sequences in (a, b) converging 
to a, then lim/(s n ) = lim/(t n ). 

Momentarily accepting (1) and (2) as valid, we define 

f(a ) = lim/(s n ) for any sequence 
(s n ) in (a, b ) converging to a. 


( 1 ) 

(2) 

(3) 


Assertion (1) guarantees the limit exists, and assertion (2) guaran¬ 
tees this definition is unambiguous. The continuity of / at a follows 
directly from (3); see Exercise 17.15. 

To prove (1), note that (s n ) is a Cauchy sequence, so (f(s n )) is 
also a Cauchy sequence by Theorem 19.4. Hence ( f(s n )) converges 
by Theorem 10.11. To prove (2) we create a third sequence (u n ) such 
that (s n ) and (t n ) are both subsequences of (u n ). In fact, we simply 
interleaf (s n ) and (t n ): 


() to =1 {si,tl, s 2 ,t 2 , s 3 ,t 3 , S 4 ,t 4 , S 5 ,t 5 , . . .). 

It is evident that lirri u n = a, so lim f(u n ) exists by (1). Theorem 11.3 
shows the subsequences (f(s n )) and ( f{t n )) of ( f{u n )) both converge 
to lim f{u n ), so lim f(s n ) = lim f{t n ). ■ 


Example 9 

Let h(x) = — for x ^ 0. The function h defined on M by 


h(x) 


^ for x^O 
1 for r = 0 


is an extension of h. Clearly h and h are continuous at all x ^ 0. It 
turns out that h is continuous at x = 0 [see below], so h is uniformly 
continuous on (a, 0) and (0, b ) for any a < 0 < b by Theorem 19.5. 
In fact, h is uniformly continuous on K [Exercise 19.11]. 

We cannot prove the continuity of h at 0 in this book because 
we do not give a definition of sinx. The continuity of h at 0 reflects 
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the fact that sinx is differentiable at 0 and its derivative there is 
cos(0) = 1, i.e., 

sin x — sin 0 sin x 

1 = Inn-= lim-; 

i->o x — 0 x->0 x 

see Fig. 19.5. The proof of this depends on how sinx is defined; 
see the brief discussion in 37.12. For a discussion of this limit and 
L’Hospital’s rule, see Example 1 in §30. □ 

Here is another useful criterion that implies uniform continuity. 

19.6 Theorem. 

Let f be a continuous function on an interval I [I may be bounded 
or unbounded ]. Let 1° be the interval obtained by removing from I 
any endpoints that happen to be in I. If f is differentiable on I and 
if f is bounded on I , then f is uniformly continuous on I. 

Proof 

For this proof we need the Mean Value theorem, which can be found 
in most calculus texts or later in this book [Theorem 29.3]. 

Let M be a bound for f on I so that | f'{x)\ < M for all x. 
Let e > 0 and let <5 = -fj. Consider a, b G I where a < b and 
\b — a| <6. By the Mean Value theorem, there exists x € (a, b ) such 
that f'(x) = ' f{b) b Z f a (a) , so 

|/(6) - /(a)| = |/'(x)| • |6 — a| < M\b - a\ < M6 = e. 

This proves the uniform continuity of / on I. ■ 
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Example 10 

Let a > 0 and consider f(x) = Jj. Since f(x ) = — ^5 we have 
|J‘ / (cc)| < Jr on [a, 00 ). Hence / is uniformly continuous on [a, 00 ) by 
Theorem 19.6. For a direct proof of this fact, see Example 2. □ 


Exercises 

19.1 Which of the following continuous functions are uniformly continuous 
on the specified set? Justify your answers. Use any theorems you wish. 

(a) /(x) = x 17 sinx — e x cos3x on [0,7r], 

(b) /(x) = x 3 on [0,1], 

(c) /(x) = x 3 on (0,1), 

(d) /(x) = x 3 on R, 

(e) f(x) = Jr on (0,1], 

(f) f(x) = sin Jj on (0,1], 

(g) f(x) = x 2 sin J on (0,1]. 

19.2 Prove each of the following functions is uniformly continuous on the 
indicated set by directly verifying the e-S property in Definition 19.1. 

(a) /(x) = 3x + 11 on R, 

(b) /(x) = x 2 on [0,3], 

(c) f(x) = l on [|,oo). 

19.3 Repeat Exercise 19.2 for the following. 

(a) /(x) = on [0,2], 

(b) f(x) = on [l,oo). 

19.4 (a) Prove that if / is uniformly continuous on a bounded set S, 

then / is a bounded function on S. Hint'. Assume not. Use 
Theorems 11.5 and 19.4. 

(b) Use (a) to give yet another proof that Jr is not uniformly 
continuous on (0,1). 
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19.5 Which of the following continuous functions is uniformly continuous 
on the specified set? Justify your answers, using appropriate theorems 
or Exercise 19.4(a). 

(a) tana: on [ 0 , J], 

(b) tana; on [ 0 , |), 

(c) ^ sin 2 x on ( 0 , 7 r], 

( d ) ^=3 on (0,3), 

(e) on (3, oo), 

( f ) on (4, oo). 

19.6 (a) Let f(x) = yfx for x > 0. Show /' is unbounded on (0,1] but 

/ is nevertheless uniformly continuous on (0,1]. Compare with 
Theorem 19.6. 

(b) Show / is uniformly continuous on [1, oo). 

19.7 (a) Let / be a continuous function on [0, oo). Prove that if / is 

uniformly continuous on [/c,oo) for some fc, then / is uniformly 
continuous on [ 0 , oo). 

(b) Use (a) and Exercise 19.6(b) to prove yfx is uniformly continuous 
on [ 0 ,oo). 

19.8 (a) Use the Mean Value theorem to prove 

| sin a; — sin?/| < \x — y\ 

for all x, y in R; see the proof of Theorem 19.6. 

(b) Show sin a: is uniformly continuous on M. 

19.9 Let f(x) = a;sin( J) for x ^ 0 and /(0) = 0. 

(a) Observe / is continuous on R; see Exercises 17.3(f) and 17.9(c). 

(b) Why is / uniformly continuous on any bounded subset of R? 

(c) Is / uniformly continuous on R? 

19.10 Repeat Exercise 19.9 for the function g where g(x) = a; 2 sin(~) for 
x ^ 0 and g( 0 ) = 0 . 

19.11 Accept the fact that the function h in Example 9 is continuous on R; 
prove it is uniformly continuous on R. 
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19.12 Let / be a continuous function on [a, 6]. Show the function /* defined 
by /*( x) = sup {f(y) : a < y < x}, for x G [o, 6], is an increasing 
continuous function on [a, 6]. 


§20 Limits of Functions 

A function / is continuous at a point a provided the values f(x) are 
near the value /(a) for x near a [and x G dom(/)]. See Definition 17.1 
and Theorem 17.2. It would be reasonable to view /(a) as the limit 
of the values f(x), for x near a, and to write lim x _>. 0 f(x) = /(a). In 
this section we formalize this notion. This section is needed for our 
careful study of derivatives in Chap. 5, but it may be deferred until 
then. 

We will be interested in ordinary limits, left-handed and right- 
handed limits and infinite limits. In order to handle these various 
concepts efficiently and also to emphasize their common features, 
we begin with a very general definition, which is not a standard 
definition. 

20.1 Definition. 

Let S' be a subset of M, let a be a real number or symbol oo or —oo 
that is the limit of some sequence in S, and let L be a real number 
or symbol +oo or —oo. We write lim x ^ a s f(x) = L if 

/ is a function defined on S, (1) 


and 

for every sequence (x n ) in S with limit a, , , 

we have lirn^oo f(x n ) = L. { 

The expression “lim 3 ,_ > . 0 s f(x)” is read “limit, as x tends to a along S, 
of f(x).” 

20.2 Remarks. 

(a) From Definition 17.1 we see that a function / is continuous at 
a in dom(/) = S if and only if lim x ^. a s f(x) = /(a). 
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(b) Observe that limits, when they exist, are unique. This follows 
from (2) of Definition 20.1, since limits of sequences are unique, 
a fact that is verified at the end of §7. □ 

We now define the various standard limit concepts for functions. 

20.3 Definition. 

(a) For a£l and a function / we write lini T _>. a f(x) = L provided 
lim a ._^ a s f{x) = L for some set S = J \ {a} where J is an 
open interval containing a. lnn T _>. a f(x) is called the [two-sided] 
limit of f at a. Note / need not be defined at a and, even if / 
is defined at a, the value /(a) need not equal liin x _>. a f(x). In 
fact, /(a) = liin x ^ a f(x) if and only if / is defined on an open 
interval containing a and / is continuous at a. 

(b) For a e R and a function / we write lim a ,_>. a + f{x) = L pro¬ 
vided lim x ^ a s f{x) = L for some open interval S = (a, b). 
lim a ._ > . 0 + f(x) is the right-hand limit of f at a. Again / need 
not be defined at a. 

(c) For a 6 M and a function / we write lim x ^. a - f{x) = L pro¬ 
vided lim x .^ a s f(x) = L for some open interval S = (c, a). 
lim x ^ a - f{x) is the left-hand limit of fat a. 

(d) For a function / we write lim^^oo f(x) = L provided 
lim f(x) = L for some interval S = (c, oo). Likewise, 
we write lim ;Z ;_ > ._ 00 f(x) = L provided lim, E _ > _ 0O s f(x) = L for 
some interval S = (—oo, 6 ). 

The limits defined above are unique; i.e., they do not depend on 
the exact choice of the set S [Exercise 20.19]. 

Example 1 

We have lim x ^.4 x 3 = 64 and lim x _ > 2 b = b because the functions x 3 

-| X Z 

and - are continuous at 4 and 2, respectively. It is easy to show 
lim x _ > o+ b = +oo and lim x ^ 0 - ] = —oo; see Exercise 20.14. It 
follows that lim x ^o ^ does not exist; see Theorem 20.10. □ 

Example 2 

Consider lim x _>.2 x x I -2 ■ This is not like Example 1, because the func¬ 
tion under the limit is not even defined at x = 2. However, we can 
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rewrite the function as 


x 2 — 4 
x — 2 


(x — 2)(x + 2 ) 
x — 2 


x + 2 for 2 . 


Now it is clear that lim x _>2 ^3^ = lim I ^ 2 (s + 2) = 4. We should 
emphasize that the functions X X Z <2 an d x + 2 are not identical. The 
domain of f(x) = x x 3<2 i s (—oo,2) U (2,oo) while the domain of 
f(x) = x + 2 is M, so that / is an extension of /. This seems like 
nitpicking and this example may appear silly, but the function /, 
not /, arises naturally in computing the derivative of g(x) = x 2 at 
x = 2. Indeed, using the definition of derivative we have 


g\2) = lim 


g{x) - g( 2) .. x z - 4 


x-2 


= lim 

x-¥2 x — 2 


so our modest computation above shows g'{ 2 ) = 4. Of course, this 
is obvious from the formula g'{x) = 2x, but we are preparing the 
foundations of limits and derivatives, so we are beginning with simple 
examples. □ 


Example 3 

Consider lim x ^.i v ^~ [ 1 • We employ a trick that should be familiar by 
now; we multiply the numerator and denominator by y/x + 1 and 
obtain 

_ (>/i-l)(v^+l) _ x — 1 _ 1 

X — 1 (x - l)(y/x + 1) (x ~ l)(y/x + 1) y/x + 1 

for x ^ 1. Hence lim x _^i ^ x _i = lim x _^i We have just 

laboriously verihed that if h(x) = y/x , then /i'(l) = i. □ 

Example 4 

Let f(x) = (x / 2 yi for i^2. Then lim^^ f(x) = lim x _^_oo f(x) = 
0 , lim x ^. 2 + f ( x ) = +°° and lim x _^ 2 - f ( x ) = — 1 oo. 

To verify linx^oo f(x) = 0, we consider a sequence (x n ) such 
that lim^oo x n = +oo and show lim n _ > , 00 f(x n ) = 0. This will show 
limj._j. 053 S f(x) = 0 for S = (2, oo), for example. Exercise 9.11 and 
Theorem 9.9 show lim n ^. 00 (x n — 2) 3 = +oo, and then Theorem 9.10 
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shows 

lim f(x n ) = lim (x n - 2) -3 = 0. (1) 

n—> oo n—> oo 

Here is a direct proof of (1). Let e > 0. For large n, we need \x n — 
2|~ 3 < e or e _1 < \x n — 2| 3 or e -1 / 3 < \x n — 2|. The last inequality 
holds if x n > e -1 / 3 + 2. Since lim n _ > . 0O x n = +oo, there exists N so 
that 

n > N implies x n > e -1 / 3 + 2. 

Reversing the algebraic steps above, we find 

n > N implies \x n — 2| -3 < e. 

This establishes (1). 

Similar arguments prove lim^-oo f(x) = 0 and liin x _ >2 + f(x) = 
Too. To prove lim x _>. 2 - f(x) = — oo, consider a sequence (x n ) such 
that x n < 2 for all n and lim n _ ) . 0O x n = 2. Then 2 — x n > 0 for 
all n and lim n _^. 0O (2 — x n ) = 0. Hence lim, woo (2 — x n ) 3 = 0 by 
Theorem 9.4, and 9.10 implies lim n _ ) . 0O (2 — x n )~ 3 = Too. It follows 
[Exercise 9.10(b)] that 

lim f(x n ) = lim (x n - 2) -3 = -oo. (2) 

n—>oo n—> oo 

This proves that lim x _^ 2 s f( x ) = ~°° for S = (—oo, 2), so that 
lim x _ ) . 2 - f(x) = —oo. Of course, a direct proof of (2) also can be 
given. 

The limits discussed above are confirmed in Fig. 20.1. □ 

We will discuss the various limits defined in Definition 20.3 fur¬ 
ther at the end of this section. First we prove some limit theorems 
in considerable generality. 

20.4 Theorem. 

Let fi and fi be functions for which the limits L\ = lim x ^ a s fi(x) 
and L 2 = lim x _^ a s f 2 (x) exist and are finite. Then 

(i) lim x _> a s(/i T f 2 ){x) exists and equals L\ T L 2 ; 

(ii) lim x ^ a s (/1 f' 2 )(x) exists and equals L 1 L 2 ; 

(iii) lim x ^. a s(/i//2)(x) exists and equals L 1 /L 2 provided L 2 7^ 0 
and / 2 (x') 7^ 0 for x € S. 
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Proof 

The hypotheses imply both fa and fa are defined on S and a is the 
limit of some sequence in S. Clearly the functions fi + fa and fa fa 
are defined on S and so is fa/fa if fa(x) fa 0 for x E S. 

Consider a sequence (x n ) in S with limit a. By hypotheses we 
have Li = Hindoo fa{x n ) and L 2 = lim^oo fa(x n ). Theorems 9.3 
and 9.4 now show 


lim (/i + fa){x n ) = lint fa(x n ) + lim fa(x n ) = L x + L 2 

n—>oo n—>oo n^-oo 


and 


lim (fafa)(x n ) 

n—>oo 


lim fa(x n ) 

.n—too 


lim fa(x n ) 

.n^-oo 


L1L2. 


Thus (2) in Definition 20.1 holds for fa + fa and fa fa, so that (i) and 
(ii) hold. Likewise (iii) follows by an application of Theorem 9.6. ■ 


Some of the infinite variations of Theorem 20.4 appear in Exer¬ 
cise 20.20. The next theorem is less general than might have been 
expected; Example 7 shows why. 













158 **• Continuity 


20.5 Theorem. 

Let f be a function for which the limit L = lim x ^ a s f{x) exists and 
is finite. If g is a function defined on {f(x) :i£S}U {L} that is 
continuous at L, then lirri x ^ a .s g o f(x) exists and equals g(L). 

Proof 

Note g o / is defined on S by our assumptions. Consider a sequence 
(x n ) in S with limit a. Then we have L = limn-**, f(x n ). Since g is 
continuous at L, it follows that 

g{L) = lim g{f{x n )) = lint go f(x n ). 

n—>-oo n—>• oo 

Hence lim x ^ a s g o f( x ) = g(L). U 

Example 5 

If / is a function for which the limit L = lim x _>. a f(x) exists and is 
finite, then we have lim x ^. a |/(x)| = \L\. This follows immediately 
from Theorem 20.5 with g{x) = |x|. Similarly, we have lim^^a = 
e L if we accept the fact that g(x) = e x is continuous on M. □ 

Example 6 

If / is a function for which lim x ^ 0 + fi x ) = 0 and lim MOO f(x) = 
f, then we have lim a ._^ 0 + = e° = 1 , lim x _>. 00 = e 2 , 

lim x _ > , 0 +sin(/(x)) = sin( 0 ) = 0 and lim x _>. 00 sin(/(x)) = sin y = 1 . 

□ 


Example 7 

We give an example to show continuity of g is needed in Theo¬ 
rem 20.5. Explicitly, we give examples of functions / and g such 
that lim x _> 0 f(x) = 1, lim x _n g(x) = 4 and yet lim x _ >0 9 0 f(x) does 
not exist. One would expect this limit to exist and to equal 4, but in 
the example fix) will equal 1 for arbitrarily small x while g{ 1) 7 ^ 4. 
The functions / and g are defined by f(x) = 1 + xsin f for x 7 ^ 0, 
g(x) = 4 for x 7 ^ 1, and g( 1) = —4. Clearly lim^o fi x ) = 1 an d 
lim x _^i g(x) = 4. Let x n = | for n € N. Then f(x n ) = 1 + \ sin(^); 
hence f(x n ) = 1 for even n and f(x n ) 7 ^ 1 for odd n. Therefore 
g o f{x n ) = —4 for even n and g o f(x n ) = 4 for odd n. Since 
lim n _ > , 00 x n = 0, we conclude lim x _ > o g o f[x) does not exist. □ 
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As in Theorem 17.2, the limits defined in Definitions 20.1 and 20.3 
can be recast to avoid sequences. First we state and prove a typi¬ 
cal result of this sort. Then, after Corollary 20.8, we give a general 
scheme without proof. 

20.6 Theorem. 

Let f be a function defined on a subset S o/M, let a be a real number 
that is the limit of some sequence in S, and let L be a real number, 
then lim x ^ a s f(x) = L if and only if 

for each e > 0 there exists 8 > 0 such that . . 

iGS and \x — a\ < 8 imply \f(x) — L\ < e. 

Proof 

We imitate our proof of Theorem 17.2. Suppose (1) holds, and con¬ 
sider a sequence (x n ) in S such that lin^^oo x n = a. To show 
lintn^oo f(x n ) = L, consider e > 0. By (1) there exists 8 > 0 such 
that 


x £ S and \x — a| < 8 imply | f(x) — L\ < e. 

Since lim n ^. 00 x n = a, there exists a number N such that n > N 
implies \x n — a\ < 8. Since x n 6 S for all n, we conclude 

n > N implies | f{x n ) — L\ < e. 

Thus lirn^oo f(x n ) = L. 

Now assume lim a ,_ ) . a s f(x) = L, but (1) fails. Then for some e > 0 
the implication 

“x € S and \x — a\ < 8 imply | f(x) — L\ < e” 

fails for each 8 > 0. Then for each n € N there exists x n in S 
where \x n — a\ < - while \f(x n ) — L\ > e. Hence (x n ) is a sequence 
in S with limit a for which limn^oo f(x n ) = L fails. Consequently 
lim x _^ a s f(x) = L fails to hold. ■ 

20.7 Corollary. 

Let f be a function defined on J \ {a} for some open interval J 
containing a, and let L be a real number. Then lim x ^. a f(x) = L if 
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and only if 


for each e > 0 there exists 6 > 0 such that 
0 < \x — a| < 6 implies \ f(x) — L\ < e. 


(1) 


20.8 Corollary. 

Let f be a function defined on some interval ( a,b), and let L be a 
real number. Then lim 2 ._ > . a + f{x) = L if and only if 


for each e > 0 there exists 6 > 0 such that 
0 < x < a + 8 implies \f(x) — L\ < e. 


( 1 ) 


20.9 Discussion. 

We now consider lim x _» s f(x) = L where L can be finite, +oo or 
—oo, and s is a symbol a, a + , a~ , oo or —oo [here a E R]. Note 
we have 15 [= 3-5] different sorts of limits here. It turns out that 
lim x _>. s f(x) = L if and only if 


for each 


there exists 


such that 


implies 


( 1 ) 


For finite limits L, the first and last blanks are filled in by “e > 0” 
and U \f(x) — L\ < e.” For L = +oo, the first and last blanks are filled 
in by “M > 0” and “/(x) > M,” while for L = —oo they are filled 
in by “M < 0” and “/(x) < M.” When we consider lim x _^. 0 f(x), 
then / is defined on J \ {a} for some open interval J containing 
a, and the second and third blanks are filled in by “<5 > 0 ” and 
“0 < \x — a\ < 8 For lim x ^. a + f(x) we require / to be defined on 
an interval (a, b ) and the second and third blanks are filled in by 
“8 > 0” and “a < x < a + 5.” For lim x ^ a - f(x) we require / to 
be defined on an interval (c, a) and the second and third blanks are 
filled in by “8 > 0” and “a — 8 < x < a.” For lirn^oo f(x) we require 
/ to be defined on an interval (c, oo) and the second and third blanks 
are filled in by “a < oo and “a < x A similar remark applies to 
lim^-oo f(x). 

The assertions above with L finite and s equal to a or a + are 
contained in Corollaries 20.7 and 20.8. □ 


20.10 Theorem. 

Let f be a function defined on J \ {a} for some open interval 
J containing a. Then lim x ^. a f(x) exists if and only if the limits 
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lim x _^ a + f(x) and lim 3 ,_ >a - f(x) both exist and are equal, in which 
case all three limits are equal. 

Proof 

Suppose lim x _>. a f(x) = L and L is finite. Then (1) in Corol¬ 
lary 20.7 holds, so (1) in Corollary 20.8 obviously holds. Thus we 
have lim x ^ a + f(x) = L; similarly lim x _> a - f(x) = L. 

Now suppose lim x _ >a + f(x) = lirn x ^ a - f(x) = L where L is finite. 
Consider e > 0; we apply Corollary 20.8 and its analogue for a~ to 
obtain <5i > 0 and 82 > 0 such that 

a < x < a + 8 1 implies | f(x) — L\ < e 


and 


a — 82 < x < a implies | f(x) — L | < e. 

If 8 = rnin{(5i, 82 } : then 

0 < \x — a| < 5 implies |/(a;) — L\ < e, 

so lim x -> a f(x) = L by Corollary 20.7. 

Similar arguments apply if the limits L are infinite. For example, 


suppose lim x ^ a f(x) = +00 and consider M > 0. There exists <5 > 0 
such that 


0 < \x — a\ < 8 

implies 

fix) > M. 

(1) 

Then clearly 

a < x < a + 8 

implies 

fix) > M 

( 2 ) 

and 

a — 8 < x < a 

implies 

fix) > M, 

(3) 

so that lim x _j. 

a+ f(x) = lim x ^ a - 

- fix) = 

+ 00 . 



As a last example, suppose lim x _ >a + f(x) = lim x ^ a - f(x) = + 00 . 
For each M > 0 there exists <5i > 0 so that (2) holds, and there 
exists 82 > 0 so that (3) holds. Then (1) holds with 8 = min{(5i, 82 ]- 
We conclude lim x ^. a f[x) = + 00 . ■ 
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20.11 Remark. 

Note lim x _>._ 0O f(x) is very similar to the right-hand limits lim 3 ,_ ) . a + 
f(x). For example, if L is finite, then lim x _ > . a + f(x) = L if and only 
if 


for each e > 0 there exists a > a such that , . 

a < x < a implies | f(x) — L | < e, 

since a > a if and only if a = a + 5 for some 8 > 0; see Corol¬ 
lary 20.8. If we set a = —oo in (1), we obtain the condition (1) in 
Discussion 20.9 equivalent to lim a; _j ._ 00 f(x) = L. 

In the same way, the limits lim^^oo f(x) and lim x ^ a ^ f(x) will 
equal L [L finite] if and only if 


for each e > 0 there exists a < a such that , . 

a < x < a implies | f(x) — L | < e. 

Obvious changes are needed if L is infinite. □ 


Exercises 

20.1 Sketch the function f(x) = ZZ. Determine, by inspection, the lim¬ 
its lim^o a f(x), lim X ^. Q +f(x), lim^o - f(x), lim x _ ) ._ 00 f(x) and 
lim x _j.o f(x) when they exist. Also indicate when they do not exist. 

20.2 Repeat Exercise 20.1 for f(x) = 

20.3 Repeat Exercise 20.1 for f(x) = See Example 9 of §19. 

20.4 Repeat Exercise 20.1 for f(x) = a;sin -. 

20.5 Prove the limit assertions in Exercise 20.1. 

20.6 Prove the limit assertions in Exercise 20.2. 

20.7 Prove the limit assertions in Exercise 20.3. 

20.8 Prove the limit assertions in Exercise 20.4. 

20.9 Repeat Exercise 20.1 for f(x) = ^r~- 

20.10 Prove the limit assertions in Exercise 20.9. 

20.11 Find the following limits. 

(a) lirn^a ^5^ (b) lim x _> 6 ^zf" ■. b> 0 

(c) lim x _> a x x Za Hint: x 3 —a 3 = (x—a)(x 2 +ax+a 2 ). 
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20.12 (a) Sketch the function f(x) = [x — 1) 1 (x — 2) 2 . 

(b) Determine lim a _ > 2+ fix), lim a ,_ > ,2- fi x ), linL c _ >1 + fi x ) and 

f(x). 

(c) Determine \im x ^.2 fix) and lim x _»i /( x) if they exist. 

20.13 Prove that if lim x _» a f(x) = 3 and lim X ^. a g(x) = 2, then 

(a) \im x ^ a [3fix) + g{x) 2 } = 13, 

(b) ^ 

(c) lim x ^ a ^3fix) +8g(x) = 5. 

20.14 Prove lim x _ >0 + - = +oo and lim x _^o- y = — oo. 

20.15 Prove linr^-oo f{x) = 0 and lim x _ >2 + fix) = +oo for the function 
/ in Example 4. 

20.16 Suppose the limits L\ = lim x _ >a + fiix) and L 2 = lim a _ >Q + f 2 ix) 
exist. 

(a) Show if fiix) < / 2 (a:) for all x in some interval (a, b), then 
L\ < Li2- 

(b) Suppose that, in fact, fiix) < / 2 (a:) for all x in some interval 
(a, b). Can you conclude Li < L 2 ? 

20.17 Show that if lim x _ >Q + fiix) = lim x _ >0 + / 3 (x) = L and if fiix) < 
/ 2 (a:) < fzi x ) for all x in some interval (a, b), then lim a _ >a + / 2 (x) = 
L. This is called the squeeze lemma. Warning : This is not immediate 
from Exercise 20.16(a), because we are not assuming lim a _ >Q + / 2 ( x) 
exists; this must be proved. 

20.18 Let fix) = v ' 1+ x ? 2 ~ 1 - for x 7^ 0. Show lim^o fix) exists and 
determine its value. Justify all claims. 

20.19 The limits defined in Definition 20.3 do not depend on the choice 
of the set S. As an example, consider a < 61 < 62 and suppose / 
is defined on (0,62)- Show that if the limit lim a _ >Q s fix) exists for 
either S = (a, 61) or S = (a, 62), then the limit exists for the other 
choice of S and these limits are identical. Their common value is 
what we write as lim x _ >£t + fix). 

20.20 Let /1 and / 2 be functions such that lim^aS fiix) = +00 and such 
that the limit L 2 = lim x _ >a s / 2 (^) exists. 

(a) Prove lim x _^ a s(/i + / 2 )(x) = +00 if L 2 7^ —00. Hint: Use 
Exercise 9.11. 
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(b) Prove lim a ._ H1 s(/i/2)(a:) = +oo if 0 < L- 2 < +oo. Hint: Use 
Theorem 9.9. 

(c) Prove lim T ^ 0 s (/i f‘ 2 )(x) = —oo if —oo < L 2 < 0. 

(d) What can you say about lim a .^ a s(/i/2)(x) if L 2 = 0? 


§21 * More on Metric Spaces: Continuity 

In this section and the next section we continue the introduction to 
metric space ideas initiated in §13. More thorough treatments appear 
in [33,53] and [62]. In particular, for this brief introduction we avoid 
the technical and somewhat confusing matter of relative topolo¬ 
gies that is not, and should not be, avoided in the more thorough 
treatments. 

We are interested in functions between metric spaces (S, d ) and 
( S*,d *). We will write “/: S -> S*” to signify dom(/) = S and / 
takes values in S*, i.e., f{x) £ S* for all s £ S. 

21.1 Definition. 

Consider metric spaces (S, d) and ( S*,d *). A function f:S —>■ S* is 
continuous at so in S if 

for each e > 0 there exists <5 > 0 such that , , 

d(s, s 0 ) < 5 implies d*(f(s),f(s 0 )) < e. 

We say / is continuous on a subset E of S if / is continuous at each 
point of E. The function / is uniformly continuous on a subset E of 
S if 

for each e > 0 there exists 5 > 0 such that , 

s,t £ E and d(s,t ) < 6 imply d*(f(s),f(t )) < e. 

Example 1 

Let S = S* = M and d = d* = dist where, as usual, dist(a, b) = \a—b\. 
The definition of continuity given above is equivalent to that in §17 
in view of Theorem 17.2. The definition of uniform continuity is 
equivalent to that in Definition 19.1. □ 
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Example 2 

In several variable calculus, real-valued functions with domain R 2 or 
R 3 , or even R k , are extensively studied. This corresponds to the case 
S = R k , 


d{x,y) 


( x j yj) > 

3 =1 


S* = R and d* = dist. We will not develop the theory, but gener¬ 
ally speaking, functions that look continuous will be. Some examples 
on R 2 are f(x i,x 2 ) = x\ + x 2 , f(x i,x 2 ) = x\X2\Jx\ + x\ + 1 , 
f(xi,X2) = cos(xi — x|). Some examples on R 3 are g{x\, X2, X3) = 
x\ + xl + x\, g(x I,x 2 ,x 3 ) = X1X2 + X1X3 + X 2 x 3 , g(x i,x 2 ,x 3 ) = 
e xi+a;2 l 0 g(x| + 2). □ 


Example 3 

Functions with domain R and values in R 2 or R 3 , or generally R fc , 
are also studied in several variable calculus. This corresponds to the 
case S = R, d = dist, S* = R k and 


d*(x, y) 


1 1/2 


-Vi? 


3 = 1 


The images of such functions are what nonmathematicians often call 
a “curve” or “path.” In order to distinguish a function from its image, 
we will adhere to the following terminology. Suppose 7: R —> R k is 
continuous. Then we will call 7 a path ; its image 7(R) in R fc will be 
called a curve. We will also use this terminology if 7 is defined and 
continuous on some subinterval of R, such as [a, b\; see Exercise 21 . 7 . 

As an example, consider 7 where 7 (t) = (cost,sint). This func¬ 
tion maps R onto the circle in R 2 about ( 0 , 0 ) with radius 1 . 

More generally 70(f) = (acosf, bsint) maps R onto the ellipse with 
2 2 

equation ^ = 1 ; see Fig. 21 . 1 . 


The graph of an ordinary continuous function /: R —> R looks 
like a curve, and it is! It is the curve for the path 7(f) = (f, /(t)). 
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FIGURE 21.2 


Curves in R 3 can be quite exotic. For example, the curve for the 
path h(t) = (cos t, sin t, |) is a helix. See Fig. 21 . 2 . □ 

We did not prove that any of the paths above are continuous, 
because we can easily prove the following general fact. 
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21.2 Proposition. 

Consider a function 7 : [a, b] —>• and write 

l(t) = (f 1 (t),f 2 (t),...,f k (t)) for t<E[a,b ]; 

thus /i,/ 2 ,...,/fc are real-valued functions on [ a,b\. Then 7 is 
continuous, i.e., a path, if and only if each fj is continuous. 

Proof 

Both implications follow from formula (1) in the proof of Lemma 13.3 
and Exercise 13.2: 

\xj — yj\ < d*(x,y) < Vkmax{\xj - y 3 \ : j = 1, 2 ,..., k}. (1) 

For t,to in [a,b\, (1) implies 

- /j(*o)| < d*('y(t),'y(t 0 )) for j = l,...,k, ( 2 ) 

and d*('y(t),j(t 0 )) < Vkma.x{\f j (t) - fj(t 0 )\ : j = 1,2,.. .,k}. (3) 

Suppose 7 is continuous on [a, b], and consider some j in 
{1,2,..., A;}. To show fj is continuous at to i n [a, b], given e > 0, 
select S > 0 so that d*( 7 (t), 7 (to)) < e for 1 1 — to| < <5. Then by (2), 

1 1 — to| < 8 implies \ fj(t) — fj(to)\ < e. So fj is continuous on [a, b\. 

Now suppose that each fj is continuous on [a,b\, and consider 
e > 0. For each j, there is Sj > 0 such that 

11 - t 0 1 < Sj implies | fj(t) - fj(t Q )\ < ~^=. 

For 6 = niirijd'i. 82, ■ ■ ■ , 8k} and 1 1 — to| < 8, we have 

max{|/j(t) - fj(t 0 )| : j = 1,2, ..., fe} < ~^=, 

so by (3) we have d*('y(t), 7 (to)) < e. Thus 7 is continuous at to- ■ 

The next theorem shows continuity is a topological property; see 
Discussion 13.7. 

21.3 Theorem. 

Consider metric spaces ( S,d ) and ( S*,d *). A function f:S -* S* is 
continuous on S if and only if 

f~ l (U) is an open subset of S 
for every open subset U of S*. 


(1) 
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Recall f 1 (U) = {s G S : f(s) G U}. 

Proof 

Suppose / is continuous on S. Let U be an open subset of S*, and 
consider so G / -1 (?7). We need to show sq is interior to / -1 (f7). 
Since /(so) G [/ and £/ is open, we have 

{ S *GS*:d*( S *,/( So ))<e}CU (2) 

for some e > 0. Since / is continuous at so, there exists S > 0 such 
that 


d(s,s 0 )<5 implies d*(f(s),f(s 0 ))<e. (3) 

From (2) and (3) we conclude d(s, so) < <5 implies f(s) is in [/; hence 
s G / _1 (C/). That is, 

{seS:d(s,s 0 )<5}Qf- 1 (U), 

so that so is interior to / _1 (17). 

Conversely, suppose (1) holds, and consider so G S and e > 0. 
Then U = {s* G S* : d*(s*,f(so)) < e} is open in S*, so f~ 1 (U) is 
open in S. Since so G / _1 ({7), for some <5 > 0 we have 

(s G S' : d(s,s 0 ) < <5} C / _1 ([7). 


It follows that 

d(s,s 0 ) < 5 implies d*(f(s), f(s 0 )) < e. 

Thus / is continuous at sq- ■ 


Continuity at a point is also a topological property; see Exer¬ 
cise 21.2. Uniform continuity is a topological property, too, but if 
we made this precise we would be led to a special class of topologies 
given by so-called “uniformities.” 
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We will show continuous functions preserve two important topo¬ 
logical properties: compactness, and connectedness which will be 
defined in the next section. The next theorem and corollary illustrate 
the power of compactness. 

21.4 Theorem. 

Consider metric spaces (S,d), ( S*,d *) and a continuous function 
f:S S*. Let E be a compact subset of S. Then 

(i) f(E) is a compact subset of S*, and 

(ii) / is uniformly continuous on E. 

Proof 

To prove (i), let U be an open cover of f(E). For each U £LlA, / _ 1 (H) 
is open in S. Moreover, {/ - 1 (H) : U E U} is a cover of E. Hence 
there exist Hi, U 2 , ■ ■ ■, U m in U such that 

e c r\u 1) u r\u 2 ) u • • • u r\u m ). 

Then 

f{E) C Hi U H 2 U • • • U U m , 

so {Hi, H 2 ,..., U m } is the desired finite subcover of U for f(E). This 
proves (i). 

To establish (ii), let e > 0. For each s E E there exists 5 S > 0 
[this 5 depends on s] such that 

d(s,t)<5 s implies d*(f(s),f(t))<'-. ( 1 ) 

For each s E E, let V s = {t E S : d(s,t ) < 5 ^}. Then the family 
V = {14 : s E E} is an open cover of E. By compactness, there exist 
finitely many points si, s 2 ,..., s n in E such that 

ecv s1 uy S 2 u-uf v 

Let < 5=3 min{<5 si , S S2 ,..., <5 Sn }. We complete the proof by showing 

s,t E E and d(s,t) < 6 imply d*(f(s),f(t))<e. (2) 

For some k in {1,2,..., n} we have s E V Sk , i.e., d(s, Sk ) < ^d Sk . Also 
we have 

d(t, s k ) < d(t, s ) + d(s, s k ) < S + ~8 Sk < 8 Sk . 
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Therefore applying (1) twice we have 

| and d*(f{t),f(s k ))<-. 

Hence d*(f(s),f(t )) < e as desired. ■ 

Assertion (ii) in Theorem 21.4 generalizes Theorem 19.2. The 
next corollary should be compared with Theorem 18.1. 

21.5 Corollary. 

Let f be a continuous real-valued function on a metric space ( S,d ). 
If E is a compact subset of S, then 

(i) f is bounded on E, 

(ii) / assumes its maximum and minimum on E. 

Proof 

Since f(E) is compact in R, the set f(E) is bounded by Theo¬ 
rem 13.12. This implies (i). 

Since f{E) is compact, it contains sup f{E) by Exercise 13.13. 
Thus there exists «o 6 E so that /(so) = sup f(E). This tells us 
/ assumes its maximum value on E at the point so- Similarly, / 
assumes its minimum on E. ■ 

Example 4 

All the functions / in Example 2 are bounded on any compact subset 
of R 2 , i.e., on any closed and bounded set in R 2 . Likewise, all the 
functions g in Example 2 are bounded on each closed and bounded 
set in R 3 . □ 

Example 5 

Let 7 be any path in R fc ; see Example 3. For —oo < a < b < oo, 
the image 7 ([a, 6 ]) is closed and bounded in R fc by Theorem 21.4. 
Note Corollary 21.5 does not apply in this case, since the set S* in 
Theorem 21.4 is R fc , not R. Theorem 21.4 also tells us 7 is uniformly 
continuous on [a, b]. Thus if e > 0, there exists 6 > 0 such that 

s,t £ [a, b] and |s — f| < 5 imply d('y(s),'y(t)) < e. 

This fact is useful in several variable calculus, where one integrates 
along paths 7 ; compare Discussion 19.3. □ 
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Example 6 

Consider a function / : E —> R, where E be a compact subset of R. 
We will show / is continuous if and only if its graph G = {(t,f(t)) : 
t E E} is a compact subset of R 2 . Suppose first that / is continuous. 
The proof of Proposition 21.2 shows y(s) = ( s , f(s)) is a continuous 
function on E, so its image 7 (E) = G is compact by Theorem 21.4(i). 

Now assume G is compact, but / is not continuous at to i n E. 
Then there exists an e > 0 and a sequence (t n ) in E such that 

lim t n = t 0 and \f(t n )-f(t 0 )\>e for all n. ( 1 ) 

n 

Since G is a bounded set, the Bolzano-Weierstrass Theorem 13.5 
shows (t n , f(t n )) has a convergent subsequence (t nfc , f(t nk )). Its limit 
is in G, because G is closed in R 2 by the Heine-Borel Theorem 13.12. 
Thus there exists t in E so that lim k(t nk , f(t nk )) = (t,/(t)). Since 
lim n t n = t 0 , we have t = t 0 , and therefore lim fe (t nfc , /(t n J) = 
(to,f(to)). In particular, lim kf(t nk ) = /(to), which contradicts the 
inequality in ( 1 ). 

Mark Lynch [44] uses the fact above to give a very interesting 
construction of a continuous nowhere-differentiable function on a 
closed interval [0,1]; see his construction on page 361. □ 

21.6 Remark. 

The remainder of this section will be devoted to the Baire Cate¬ 
gory Theorem and some interesting consequences. We will need some 
metric-space terminology, some of it from §13. Let (S', d) be a metric 
space. For a subset E of S, its complement is S\E = {s E S : s ^ E}. 
A point s is in the interior of a set E, or interior to E, if s E V CE 
for some open subset V of S. A subset E of S is closed if S \ E is 
open. A point s is in the closure of a set E if every open set con¬ 
taining s also contains an element of E. We write E~ for the set of 
points in the closure of E. 

A subset D of S is dense in S if every nonempty open set U 
intersects D, i.e., DCiU 7 ^ 0 . For example, Q is dense in R, since every 
nonempty open interval in R contains rationals; see 4.7 on page 25. 
Finally, a totally new definition: a subset E of S is nowhere dense in 
S if its closure E~ has empty interior. Obviously E is nowhere dense 
if and only if E~ is nowhere dense. Also, E is nowhere dense in S if 
and only if S \ E~ is dense in S. 
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Each part of the next theorem is a variant of what is called the 
Baire Category Theorem. After that theorem, we will give the ulti¬ 
mate version of this theorem and explain the terminology “category.” 
Just as in Example 4 on page 88, open balls B r {x o) = {x E S : 
d(x,x o) < r} in S are open sets, and closed balls C r (x o) = {x E S : 
d(x,x o) < r} are closed sets. Note C^xo) ^ B r (x o) for s <r. 

21.7 Theorem. 

Let ( S , d) be a complete metric space. Then 

(a) If (U n ) is a sequence of dense open subsets of S, then the 
intersection X = r\ff = 1 U n is dense in S. 

(b) If (F n ) is a sequence of closed subsets of S and if the union 
F = U^ =1 F n contains a nonempty open set, then so does at 
least one of the sets F n . 

(c) The union of a sequence of nowhere dense subsets of S has dense 
complement. 

(d) The space S is not a union of a sequence of nowhere dense 
subsets of S. 

Proof 

All the hard work will be in proving: Part (a). Consider a nonempty 
open subset V of S; we need to show Ink 7 ^ 0 . Since JJ\ is open 
and dense and V is open, U\ n V is open and nonempty. So there 
exists x\ £ U\ n V and r\ < 1 so that C ri (x 1 ) C U\ n V. Since C/ 2 is 
open and dense and B ri (x 1 ) is open, there exists X 2 E B ri (x 1 ) D U 2 
and T 2 < 4 so that C r2 (x 2 ) C B ri (x 1 ) n U 2 - Continuing, we obtain 
sequences (xk) in S and positive numbers (r&) so that 

x k+1 € B rk {x k ), r k < and C rk+1 (x k+1 ) C B rk (x k ) n U k+1 . 

Note d(x k ,x k+ 1 ) < r k for all k, so for m < n we have 

n— 1 n— 1 j 00 ^ ^ 

d(x m ,x n ) < Y, d{x k ,x k+ 1 ) < Y = 2 ^= 2 - 

k=m k=m k=m 

Thus the sequence (x k ) is a Cauchy sequence in S. Since S is 
complete, we have lim^ x k = x for some i£S. Since we have 

X k G C rk (x k ) c C rn (x n ) for k> n, 
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and since C rn (x n ) is closed, x also belongs to C Tn . This is true for 
all n, so 


® 6 n Cr n (x n ) c p| u n =x. 

n =1 n =1 

Since we also have x E C ri (x i) C V, we conclude x € X n V, as 
desired. 

Part (b). Suppose U^L 1 F n has nonempty interior. Then S \ 
Aff =l F n = n^B =1 (S' \ F n ) is not dense in S. Since the sets S \ F n 
are open, part (a) shows that at least one of them, say S \ F m , is 
also not dense in S. Thus its complement F m contains a nonempty 
open set. 

Part (c). Let A = U %LiA n be the union of a sequence of nowhere 
dense sets A n . We need to show the complement of A, S \ A, is 
dense in S. If we replace each A n by its closure, they will still be 
nowhere dense and S \ A only gets smaller. In other words, we may 
assume each A n is closed and nowhere dense. Part (b) implies that 
A contains no nonempty open set. Thus every nonempty open set 
intersects S\A, and S \ A is dense in S. 

Part (d). This is obvious from part (c), since the complement of 
S is the empty set 0. ■ 


Theorem 21.7 tells us in different ways that the union of a se¬ 
quence of nowhere dense subsets of a complete metric space is small 
relative to the size of S. For this reason, it is common to divide the 
subsets of S into two categories. Category 1 consists of sets that are 
unions of sequences of nowhere dense subsets of S, and Category 2 
consists of the other subsets of S. Here is part (d) of Theorem 21.7 
restated using this language. 

21.8 Baire Category Theorem. 

A complete metric space (S, d ) is of the second category in itself. 

The expression “in itself” here deserves a comment. Many topo¬ 
logical properties about sets ECS depend on the set S. For 
example, the set (0,1] is not closed in S = M, but it is closed in 
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S = (0, oo) viewed as a metric space. Category is another prop¬ 
erty that depends on S, so “in itself” in Theorem 21.8 stresses the 
reference to the complete metric space S. 1 

21.9 Corollary. 

Each of the spaces R fc is of second category in itself. 

Example 7 

Any set that can be listed as a sequence is said to be “countable.” 
Other sets are “uncountable.” 

(a) Countable unions of sets of first category are sets of first cate¬ 
gory. For example, countable subsets of R, and more generally 
of R fc , are of first category, since single points {x} in these 
spaces are nowhere dense. This and Corollary 21.9 give another 
(rather heavy-handed) proof that R is uncountable; compare 
Exercise 16.8. 

(b) Example 3 on page 70 shows the set Q of rationals is countable. 
Thus Q is of first category in R, and the set of irrationals is of 
second category in R. 

(c) Each straight line in the plane R 2 is of first category in R 2 , so 
a countable union of straight lines is of first category in R 2 . □ 

21.10 Discussion. 

A closed set E in a metric space is said to be perfect if every point 
x in E is the limit of a sequence of points in E \ {x}; compare 
Proposition 13.9(b). This proposition also shows closed subsets of 
complete metric spaces are themselves complete metric spaces. In 
a perfect subset E of a complete metric space, single points are 
nowhere dense in E, so countable subsets of E are of first cate¬ 
gory. Therefore, nonempty perfect subsets of complete metric spaces 
are uncountable. The Cantor set (in Example 5 on page 89) is an 
interesting compact perfect set. □ 

Recall Exercise 17.14, where a function on R is described that is 
continuous at each irrational and discontinuous at each rational. In 


1 One of the fine properties of compactness is: If a set is compact in some set, 

then it is compact in all sets. 
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the next example, we will show there are no functions on R that are 
continuous at only the rationals. 

Example 8 

(a) Consider any function / on R. For each x in R, let 

= inf sup{|/(y) - f(z)\ :y,z £ (x-6,x + 5)}. 

<5>0 

The function ujf is the “oscillation function” of /. The function 
/ is continuous at x if and only if ujf(x) = 0; see Exercise 21.13. 

We show each set {i 6 R : w/(i) < e} is open in 1; e > 0. 
Suppose cof(x o) < e; we need to show this inequality holds in 
an interval containing xq. By the definition, there exists 5 > 0 
such that 

sup{|/(y) - f{z) I : y,z € (x 0 - S,x 0 + 5)} < e. 

For x € (xo — |, xo +f) we have ( x — |,x+ f) C (xq — <5, xq + <5), 
and therefore 

u f (x) < sup ||/(y) - f(z) | : y,z € 

< sup{|/(y) - f(z )| : y,z E (x 0 - 5,x 0 + 5)} < e. 

(b) There is no function / on R that is continuous only on the set 
Q of rational numbers. Otherwise, by part (a) the equality 

°o , 1 

Q = {x E R : ojf(x) = 0}=P|<xGR: uif(x) < — 

would express Q as the intersection of a sequence of open 
subsets of R, contrary to Exercise 21.11. □ 

21.11 Theorem. 

No nondegenerate interval I in R can be written as the disjoint 
union of two or more nondegenerate closed intervals. (An interval 
is “nondegenerate” if it has more than one point.) 

Proof 

We prove the theorem for I = [a, b\, a < b, and leave the other cases 
to Exercise 21.14. Assume I is the disjoint union of two or more 
nondegenerate closed intervals. It is clear there are infinitely many 
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such intervals, because otherwise they could be listed in order, and 
there would be points in I between the first and second interval. 
It is also clear that the family can be listed as a sequence (i.e., is 
countable), since there is a one-to-one function from the collection 
of disjoint intervals into Q. 

So we assume I = U^ = 1 [a/ C , &&]. By Discussion 13.7(iii) on page 87, 
the union U^ =1 (afc, bk) is open, so that K = /\U^ =1 (afc, 6 /, ; ) is closed. 
Then K is the set of endpoints of the removed intervals, so K is 
nonempty and countable. We will show K is perfect, and this will 
be a contradiction by Discussion 21.10. Consider x in K ; we may 
assume x ^ b. Consider an interval (x, x + h) where h > 0. Some 
closed interval [a m ,b m ] must intersect (x,x + h), and [a m ,b m ] cannot 
contain x in K. Thus x < a m < x + h. Since a m is in K, the interval 
(x, x + h) intersects K, and since h > 0 is arbitrary, x is a limit of 
points in A"\{x}. This shows K is perfect, completing the proof. ■ 

A close examination of Example 8 (b) and Theorem 21.11 shows 
they both depend on the Baire Category Theorem 21.8. Other ap¬ 
plications of this theorem appear in Theorem 38.3 and twice in 
Theorem 38.5. 


Exercises 

21.1 Show that if the functions /i, / 2 , • ■ •, fk in Proposition 21.2 are 
uniformly continuous, then so is 7 . 

21.2 Consider f: S —> S* where (S,d) and ( S*,d *) are metric spaces. 
Show that / is continuous at So £ S if and only if 

for every open set U in S* containing /(so), there is 
an open set V in S containing s 0 such that f(V) C U. 

21.3 Let (S, d) be a metric space and choose so £ S. Show f(s) = d(s, sq) 
defines a uniformly continuous real-valued function / on S. 

21.4 Consider f:S—> K where (S, d) is a metric space. Show the following 
are equivalent: 

(i) / is continuous; 

(ii) / - 1 ((a, b)) is open in S for all a < 6 ; 

(iii) / - 1 ((a, b)) is open in S for all rational a < b. 



Exercises \~f~( 


21.5 Let E be a noncompact subset of R fc . 

(a) Show there is an unbounded continuous real-valued function 
on E. Hint : Either E is unbounded or else its closure E~ 
contains Xq £ E. In the latter case, use ^ where g(x) = 
d(x,x o). 

(b) Show there is a bounded continuous real-valued function on E 
that does not assume its maximum on E. 

21.6 For metric spaces (Si, di), (S 2 ,d 2 ), (S3, cfe), prove that if /: Si —► S 2 
and g: S 2 —>• S3 are continuous, then go f is continuous from Si into 
S3. Hint : It is somewhat easier to use Theorem 21.3 than to use the 
definition. 

21.7 (a) Observe that if E C S where (S,d) is a metric space, then 

(E,d) is also a metric space. In particular, if £ C R, then 
d(a, b) = |a — b\ for a,b £ E defines a metric on E. 

(b) For 7 : [a, b] —► R fc , give the definition of continuity of 7 . 

21.8 Let (S,d) and ( S*,d *) be metric spaces. Show that if /: S —> S* is 
uniformly continuous, and if (s n ) is a Cauchy sequence in S, then 
(/(s„)) is a Cauchy sequence in S*. 

21.9 We say a function / maps a set E onto a set F provided f(E) = F. 

(a) Show there is a continuous function mapping the unit square 

{(xi,x 2 ) £l 2 : 0 <ii<l, 0 <i 2 <l} 

onto [ 0 , 1 ]. 

(b) Do you think there is a continuous function mapping [0,1] onto 
the unit square? 

21.10 Show there exist continuous functions 

(a) Mapping (0,1) onto [0,1], 

(b) Mapping (0,1) onto R, 

(c) Mapping [0,1] U [2,3] onto [0,1]. 

(d) Explain why there are no continuous functions mapping [0,1] 
onto (0,1) or R. 

21.11 Show the set Q of rational numbers is not the intersection of a 
sequence of open sets, so that the set R \ Q of irrational numbers is 
not the union of a sequence of closed subsets of R. 
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21.12 Give an example of an infinite disjoint sequence of subsets of R, each 
of which is of second category in R. 

21.13 Let uif be the oscillation function in Example 8(a). Show that / is 
continuous at x in R if and only if tOf{x) = 0. 

21.14 Complete the proof of Theorem 21.11. Hint : Assume a nondegener¬ 
ate interval / in R is the union of two or more disjoint nondegenerate 
closed intervals. Select points x < y in /, so that they are interior to 
two distinct such subintervals. Show [x, y} is also the union of two or 
more disjoint nondegenerate closed intervals, contradicting the case 
covered in the proof of Theorem 21.11. 


§22 * More on Metric Spaces: 

Connectedness 

Consider a subset E of R that is not an interval. As noted in the 
proof of Corollary 18.3, the property 

Vi,V 2 ^E and yi < y < y 2 imply y&E 

must fail. So there exist y \, y 2 , y in M such that 

Vi<y<V 2 , yi,y 2 €E, y£E. (*) 

The set E is not “connected” because y separates E into two pieces. 
Put another way, if we set U\ = (—oo ,y) and U 2 = (y, oo), then we 
obtain open sets so that EC\U\ and EDU 2 are disjoint nonempty sets 
who union is E. The last observation can be promoted to a useful 
general definition. 

22.1 Definition. 

Let E be a subset of a metric space (S, d). The set E is disconnected 
if one of the following two equivalent conditions holds. 

(a) 2 There are open subsets U\ and U 2 of S such that 

(EnU 1 )n{EnU 2 ) = 0 and E = (EnU 1 )U(EnU 2 ), (1) 
EnU 1 ^0 and EnU 2 ^ 0 . (2) 


2 Readers familiar with relative topologies will recognize this as stating that E is 
a disjoint union of nonempty relatively-open subsets of E. 
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(b) There are disjoint nonempty subsets A and B of E such that 
E = A U B and neither set intersects the closure of the other 
set, i.e., 

A~ HB = 0 and AnB~ = 0. (3) 

A set E is connected if it is not disconnected. 

Remark. We show that conditions (a) and (b) above are 
equivalent. 

If (a) holds, set A = E n U\ and B = E n C/ 2 . To check (b), we 
need only verify (3). If, for example, A~ n B 7/ 0, then there exists 
b 6 A~ DB C C/ 2 , so there is r > 0 so that {s 6 S : d(s, b) < r} C C/ 2 . 
Since b is in A~, Proposition 13.9(c) shows there is a in A such that 
d(a, b) < r. But then a E U 2 n E = B, a contradiction, since A and 
B are disjoint. Thus (3) holds, and condition (b) holds. 

Now suppose that (b) holds. Let U\ = S \ B~ and U 2 = S \ A~. 
To verify (a), it suffices to show E n U\ = A and E n C /2 = B. 
For example, x G E n U\ implies x E S \ B implies x ^ B. Since 
x 6 A U B, we conclude x 6 A. Finally, if a: € A, then x ^ B~ 
by (3), so x G S \ B~ = U\. Therefore x is in E n U\. We’ve shown 
E n Ui = A. 


Example 1 

As noted before the definition, sets in M that are not intervals are 
disconnected. Conversely, intervals in M are connected. To prove this 
from the definition, we will assume the contrary and obtain a con¬ 
tradiction. So we assume there is an interval / and open sets C/i and 
C /2 disconnecting I as in Definition 22.1(a). Select a 6 / fl U\ and 
b E In C/ 2 . We may suppose a < b. Now the interval [a,b\ satisfies 
the same conditions in Definition 22.1(a) as I. So we may assume 
I = [a, b\, a € U\ and b € 112 - 

Let t = sup [a, b) flC/i, so that t > a. Since (b — e, b] C C /2 for some 
e > 0, we also have t < b. If t is in U\, then [t,t + e) C U\ n [a, b] 
for some e > 0, but then t = sup[a, b) fl U\ > t + e. If t G C/ 2 , then 
(t — e, t] C C /2 fl [a, b\, which would imply t = sup[a, b) D U\ < t — e. 
Each possibility leads to a contradiction, so [a, b] and the original 
interval I are connected. □ 
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22.2 Theorem. 

Consider metric spaces (S,d), ( S*,d *), and let f:S S* be con¬ 
tinuous. If E is a connected subset of S, then f(E) is a connected 
subset of S*. 

Proof 

Assume f(E) is not connected in S*. Then there exist open sets V\ 
and V 2 in S* such that 

(f(E) n fh) n (f(E) n v 2 ) = 0, f(E) = (f(E) n Pi) u (f(E) n v 2 ), 
f(E) nVi /0 and f(E) n V 2 + 0 . 

Let U\ = f~ l (V\) and U 2 = / _ 1 (T 2 ). Then U\ and U 2 are open 
sets in S that separate E as in Definition 22.1(a). Thus E is not 
connected, a contradiction. ■ 

The next corollary generalizes Theorem 18.2 and its corollary. 

22.3 Corollary. 

Let f be a continuous real-valued function on a metric space (S, d). 
If E is a connected subset of S, then f(E) is an interval in M. In 
particular, f has the intermediate value property. 

Example 2 

Curves are connected. That is, if 7 is a path in as described in 
Example 3 of §21, page 165 and / is a subinterval of M, then the 
image 7 (!) is connected in M fc . □ 

22.4 Definition. 

A subset E of a metric space (S, d) is said to be path-connected if, 
for each pair s, t of points in E, there exists a continuous function 
7 : [a, b\ — > E such that 7 (a) = s and 7 ( 6 ) = t. We call 7 a path. 

22.5 Theorem. 

If E in ( S,d ) is path-connected, then E is connected. [The failure of 
the converse is illustrated in Exercise 22-4-] 

Proof 

Assume E is disconnected by open sets U\ and C/ 2 : 

(Enc/i)n (Enu 2 ) = 0 and E = (E r U\) u(£n U 2 ), (1) 
E n Ui 7 / 0 and E nU 2 ^ 0 . ( 2 ) 
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FIGURE 22.1 


Select s £ E n U\ and t E E n Let 7 : [a, b\ E be a path where 
7 (a) = s and 7 ( 6 ) = t. Let F = 7 ([a, &]). Then (1) and (2) hold 
with F in place of E. Thus F is disconnected, but F is connected by 
Theorem 22.2. ■ 


Figure 22.1 gives a path-connected set and a disconnected set 
in M 2 . 

Example 3 

Many familiar sets in such as the open ball {x : d(x, 0) < r}, the 
closed ball { x : d(x, 0 ) < r} and the fc-dimensional cube 

{x : max{|xj| : j = 1 , 2 ,..., k} < 1 } 
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are convex. A subset E of is convex if 

x,y G E and 0 < t < 1 imply tx + (1 — t)y G E, 

i.e., whenever E contains two points it contains the line segment 
connecting them. See Fig. 22.1. Convex sets E in are always 
path-connected. This is because y(t) = tx + (1 — t)y defines a path 
7 : [0,1] — > E such that 7 ( 0 ) = y and 7 ( 1 ) = x. For more details, see 
any book on several variable calculus. □ 

Example 4 

This example is adapted from [15]. Suppose I is an interval in M 
and / : / -i 1 is a function with graph G = {(x,f(x)) : x G I}. 
Then / is continuous if and only if G is path-connected. Note 
that “path-connected” here cannot be changed to “connected;” see 
Exercise 22.13. 

If / is continuous, then for each (a, /(a)) and ( 6 , f(b)) in G , y(t) = 
( t , f(t)) is a path connecting these points. Note that 7 is continuous 
by Proposition 21.2. 

For the converse, assume G is path-connected. Consider a, b in I 
where a < b. Since G is path-connected, there is a continuous func¬ 
tion 7 : [0,1] -4 G satisfying 7 ( 0 ) = (a, /(a)) and 7 ( 1 ) = ( 6 , /(&)). By 
Proposition 21.2, we can write 7 (t) = (x(t),y(t)) where x and y are 
continuous real-valued functions on [0.1]. Of course, y(t) = f(x(t )) 
for all t. First, we claim 

{{z, f (z)) : z G [fl, b\} C 7 ([0,1]). (1) 

Since x(t) is continuous on [0,1], x(0) = a and x{l) = b, the 
Intermediate Value Theorem 18.2 for continuous functions shows 
that if z is in (a, 6), then x(t) = z for some t G (0,1). Thus 
( z,f(z )) = (x(t), f(x(t))) = 7 (t). Since the cases z = a and z = b 
are trivial, this implies ( 1 ). 

Next we show / satisfies IVP, the intermediate value property: 
(IVP) If a, 6 G I, a < b and c is between /(a) and f(b), then 
f(x) = c for some x G [a, b\. 

Let a = sup{f G [0,1] : x(t) < a} and /? = inf{t G [0,1] : 
x(t) > 6 }. Thus 0 < a < f3 < 1. Since x(t) is continuous, we see 
that x([a,{3}) = [a, b\. Now we apply the Intermediate Value Theo¬ 
rem again, this time to f(x(t )) on [a,/3\. Since f(x(a )) = /(a) and 
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f(x(/3)) = f(b), we have f(x(t)) = c for some t in (a,/3). For this t 
we have x(t) G [a, 6 ], so we have verified IVP. 

Now assume / is not continuous on I. Then there exists xq G /, 
e > 0 , and a sequence (x n ) in I that converges to xq satisfying 
I f{x n ) - fix 0 )| > e for all n. Then f(x n ) > f(x 0 ) + e > f(x 0 ) for 
infinitely many n, or else f{x n ) < f(x o) — e < f(x o) for infinitely 
many n. Passing to a subsequence, we may assume f(x n ) > f(x o) + 
e > f(x o) for all n , say. By the IVP, for each n there is y n between 
x n and xq so that f(y n ) = f(x 0 ) + e. Then (y n , f(y n )) is a sequence 
in G satisfying 

lim y n = x 0 and lim(y n , f{y n )) = (x 0 , f(x 0 ) + e). ( 2 ) 

n 

Moreover, there exist a < b in I such that xq and all y n belong to 
[a, b]. We apply (1) to this a and b and 7 described there. So, for each 
n G N there exists t n G [0,1] so that 7(fn) = ( y n , fiVn))- Passing to 
a subsequence {t nk )k eN of (t n ), we may assume that linifc t nk = to for 
some to in [0,1]. Since 7 is continuous, we conclude from ( 2 ) that 

7(*o) = lip 7 (tnk) = 11 ™(y nk ,f(yn k )) = (®o,/(®o) + e). 

k k 

Since this limit is not in G, and 7 ([ 0 ,1]) C G, we have a contradiction 
and / is continuous on I. □ 

We end this section with a discussion of some very different metric 
spaces. The points in these spaces are actually functions themselves. 

22.6 Definition. 

Let S be a subset of M. Let C(S) be the set of all bounded continuous 
real-valued functions on S and, for /, g G C(S), let 

d(f,g) = sup{|/(x) - g{x)\ : x G S}. 

With this definition, C(S) becomes a metric space [Exercise 22.6]. 
In this metric space, a sequence (f n ) converges to a point [function!] 
/ provided lim n _^oo d(f n , f ) = 0 , that is 

lim sup{|/ n (x) - f(x)\ : x G 5} = 0. (*) 

n— 7 -oo 

Put another way, for each e > 0 there exists a number N such that 
| f n (x) — f(x) | < e for all 16 S and n > N. 
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We will study this important concept in the next chapter, but 
without using metric space terminology. See Definition 24.2 and 
Remark 24.4 where (*) is called uniform convergence. 

A sequence (/„) in C(S ) is a Cauchy sequence with respect to 
the metric d exactly when it is uniformly Cauchy as defined in Defi¬ 
nition 25.3. In our metric space terminology, Theorems 25.4 and 24.3 
tell us that C(S) is a complete metric space. 

Exercises 

22.1 Show there do not exist continuous functions 

(a) Mapping [0,1] onto [0,1] U [2, 3], 

(b) Mapping (0, 1) onto Q. 

22.2 Show {(x\,X 2 ) € R 2 : x\ + x% = 1} is a connected subset of R 2 . 

22.3 Prove that if E is a connected subset of a metric space (S, d), then 
its closure E~ is also connected. 

22.4 Consider the following subset of R 2 : 



E is simply the graph of g(x) = sin f along the interval (0,1]. 

(a) Determine its closure E~. See Fig. 19.4. 

(b) Show E is connected. 

(c) Show E~ is not path-connected. 

22.5 Let E and F be connected sets in some metric space. 

(a) Prove that if E D F 7 ^ 0 , then E U F is connected. 

(b) Give an example to show E D F need not be connected. 
Incidentally, the empty set is connected. 

22.6 (a) Show C(S) given in Definition 22.6 is a metric space. 

(b) Why did we require the functions in C(S) to be bounded when 
no such requirement appears in Definition 24.2? 


22.7 Explain why the metric space B in Exercise 13.3 can be regarded 
as C7(N). 



Exercises 


22.8 Consider C(S) for a subset S of R. For a fixed so dr S, define F(f) = 
/(so). Show F is a uniformly continuous real-valued function on the 
metric space C(S). 

22.9 Consider f,g £ C(S) where 5CR. Let F(t) = tf + (1 — t)g. Show 
F is a uniformly continuous function from R into C(S). 

22.10 Let / be a (fixed) uniformly continuous function in C'(R). For each 
x £ R, let f x be the function defined by f x {y) = f{x + y) for y £ R. 
Let F(x) = f x ', show F is uniformly continuous from R into C(R). 

22.11 Consider C(S) where SCR, and let £ consist of all / in C(S) such 
that sup{|/(x)| : i £ S} < 1. 

(a) Show £ is closed in C(S). 

(b) Show C(S) is connected. 

(c) Show £ is connected. 

22.12 Consider a subset £ of C(S), S C R. For this exercise, we say a 
function /o in £ is interior to £ if there exists a finite subset F of S 
and an e > 0 such that 

{/ £ C(S) : \f(x) - f 0 (x)\ < e for x£F}C£. 

The set £ is open if every function in £ is interior to £. 

(a) Reread Discussion 13.7. 

(b) Show the family of open sets defined above forms a topology for 
C(S). Remarks. This topology is different from the one given 
by the metric in Definition 22.6. In fact, this topology does 
not come from any metric at all! It is called the topology of 
pointwise convergence and can be used to study the convergence 
in Definition 24.1 just as the metric in Definition 22.6 can be 
used to study the convergence in Definition 24.2. 

22.13 Let / be the function defined on [0, oo) by f(x) = (x, sin(l/x)) for 
x > 0 and /(0) = 0. Show that the graph of / is connected but not 
path-connected; compare Exercise 22.4. Is / continuous on [0, oo)? 

22.14 Consider a bounded sequence (s„) in R and its set S of subsequential 
limits as in Theorem 11.8. Show that if lim„(s n +i— s n ) = 0, then S is 
a connected interval in R. This is from [11]. Hint : Consider a < c < b 
where a and b are in S, and show c is in S. Use Theorem 11.2. 
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CHAPTER 


In this chapter we develop some of the basic properties of power se¬ 
ries. In doing so, we will introduce uniform convergence and illustrate 
its importance. In §26 we prove power series can be differentiated and 
integrated term-by-term. 


§23 Power Series 

Given a sequence (a n )“ = 0 °f r eal numbers, the series o a nX n is 
called a power series. Observe the variable x. Thus the power series 
is a function of x provided it converges for some or all x. Of course, 
it converges for x = 0; note the convention 0° = 1. Whether it 
converges for other values of x depends on the choice of coefficients 
(a n ). It turns out that, given any sequence ( a n ), one of the following 
holds for its power series: 

(a) The power series converges for all 

(b) The power series converges only for x = 0; 

(c) The power series converges for all x in some bounded interval 
centered at 0; the interval may be open, half-open or closed. 

K.A. Ross, Elementary Analysis: The Theory of Calculus, 187 

Undergraduate Texts in Mathematics, DOI 10.1007/978-1-4614-6271-2_4, 
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These remarks are consequences of the following important 
theorem. 

23.1 Theorem. 

For the power series Y a n x n , let 

fd = limsup \a n \ l/n and R = —. 

P 

[If (d = 0 we set R = +oo, and if fd = +oo we set R = 0.] Then 

(i) The power series converges for \x\ < R] 

(ii) The power series diverges for |x| > R. 

R is called the radius of convergence for the power series. Note 
that (i) is a vacuous statement if R = 0 and that (ii) is a vacuous 
statement if R = +oo. Note also that (a) above corresponds to the 
case R = +oo, (b) above corresponds to the case R = 0, and (c) 
above corresponds to the case 0 < R < +oo. 

Proof of Theorem 23.1 

The proof follows quite easily from the Root Test 14.9. Here are the 
details. We want to apply the Root Test to the series Y d n x n - So for 
each x E M, let a x be the number or symbol defined in 14.9 for the 
series Y a n x n . Since the nth term of the series is a n x n , we have 

a x = limsup |a„a:"| 1 ' / " = limsup I^Hanl 1 ^" = |a;| • limsup |a n | 1 ' / " = f)\x\. 

The third equality is justified by Exercise 12.6(a). Now we consider 
cases. 

Case 1. Suppose 0 < R < +oo. In this case a x = /3\x\ = 

If \x\ < R then a x < 1, so the series converges by the Root Test. 
Likewise, if \x\ > R , then a x > 1 and the series diverges. 

Case 2. Suppose R = +oo. Then (i = 0 and a x = 0 no matter 
what x is. Hence the power series converges for all x by the Root 
Test. 

Case 3. Suppose R = 0. Then /3 = +oo and a x = +oo for x ^ 0. 
Thus by the Root Test the series diverges for i^O. 



§23. Power Series ^gQ 


Recall that if lim | a ™ +1 1 exists, then this limit equals (3 of the last 
theorem by Corollary 12.3. This limit is often easier to calculate than 
lim sup lanl 1 /”; see the examples below. 


Example 1 

Consider 0 ±x n . If a n = then ^ so lim |^| = 0. 

Therefore /3 = 0, R = +oo and this series has radius of convergence 
Too. That is, it converges for all x in M. In fact, it converges to e x 
for all x, but that is another story; see Example 1 in §31, page 252, 
and also §37. □ 


Example 2 

Consider ^2^ =0 x n . Then (3 = 1 and R = 1. Note this series does 
not converge for s = 1 or x = -1, so the interval of convergence is 
exactly (—1,1). [By interval of convergence we mean the set of x for 
which the power series converges.] The series converges to by 
formula (2) of Example 1 in §14, page 96. □ 


Example 3 

i 

Consider n xU ' Si nce Ihn = 1, we again have (3 = 1 and 

n 

R = 1. This series diverges for x = 1 [see Example 1 of §15], but 
it converges for x = — 1 by the Alternating Series theorem 15.3 on 
page 108. Hence the interval of convergence is exactly [—1,1). □ 


Example 4 

Consider • O nce again (3 = 1 and R = 1. This series 

converges at both x = 1 and x = —1, so its interval of convergence 
is exactly [—1,1]. □ 


Example 5 

The series n - x?l h as radius of convergence R 

have lim = Too. It diverges for every r^O. 


0 because we 
□ 


Examples 1-5 illustrate all the possibilities discussed in (a)-(c) 
prior to Theorem 23.1. 
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Example 6 

Consider Y^=o 2 _n x 3n . This is deceptive, and it is tempting to cal¬ 
culate (3 = limsup(2 -Tl ) 1 / Tl = j and conclude R = 2. This is wrong 
because 2 ~ n is the coefficient of x 3n not x n , and the calculation of 
/? must involve the coefficients a n of x n . We need to handle this 
series more carefully. The series can be written a nX n where 

a^k = and a n = 0 if n is not a multiple of 3. We calculate (3 
by using the subsequence of all nonzero terms, i.e., the subsequence 
given by cr(k) = 3k. This yields 

p = limsuplonl 1 /" = lim |a 3fc | 1/3fc = lim (2" fc ) 1/3fc = 2" 1 / 3 . 

k—> oo k —^oo 

Therefore the radius of convergence is R = ^ = 2 1 / 3 . □ 

One may consider more general power series of the form 

CO 

(x-x 0 r, n 

n =0 

where xq is a fixed real number, but they reduce to series of the 
form J2n=o a nU n by the change of variable y = x — x o- The interval 
of convergence for the series (*) will be an interval centered at xq. 


Example 7 

Consider the series 


OO 


E 

71=1 


(-l ) n+1 


l) n . 


(1) 


The radius of convergence for the series — V™ is R = 1, so 

the interval of convergence for the series (1) is the interval (0, 2) plus 
perhaps an endpoint or two. Direct substitution shows the series (1) 
converges at x = 2 [it’s an alternating series] and diverges to — oo at 
x = 0. So the exact interval of convergence is (0, 2]. It turns out that 
the series (1) represents the function log e x on (0, 2 ], See Examples 1 
and 2 in S 26. □ 
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FIGURE 23.1 


On of our major goals is to understand the function given by a 
power series 

oo 

fix) = a kX k for |s| < R. 
k =0 

We are interested in questions like: Is / continuous? Is / differen¬ 
tiable? If so, can one differentiate / term-by-term: 

OO 

fix) = ^ ka k x fc_1 ? 

k =1 

Can one integrate / term-by-term? 

Returning to the question of continuity, what reason is there to 
believe / is continuous? Its partial sums f n = Yl'k =o a k xk are contin¬ 
uous, since they are polynomials. Moreover, we have lim^^oo f n (x) = 
f(x ) for |x| < R. Therefore / would be continuous if a result like 
the following were true: If (/ n ) is a sequence of continuous functions 
on (a, b) and if lim n _ KX , f n (x) = f(x) for all x E (a, 6), then / is 
continuous on (a, b). However, this fine sounding result is false! 

Example 8 

Let f n (x) = (1 — \x\) n for x E (—1,1); see Fig. 23.1. Let f(x) = 0 
for x ^ 0 and let /(0) = 1. Then we have lim^^oo f n (x) = f(x) 
for all x E (—1,1), since lim n _ >00 a n = 0 if |a| < 1. Each f n is a 
continuous function, but the limit function / is clearly discontinuous 
at x = 0. □ 

This example, as well as Exercises 23.7-23.9, may be discourag¬ 
ing, but it turns out that power series do converge to continuous 
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functions. This is because 

n oo 

lim V aj~x k converges uniformly to akX k 

n—¥ 00 —< 

k =0 fc=0 

on sets [—i?i, i?i] such that R\ < R. The definition of uniform con¬ 
vergence is given in the next section, and the next two sections will 
be devoted to this important notion. We return to power series in 
§26, and again in §31. 


Exercises 


23.1 For each of the following power series, find the radius of convergence 
and determine the exact interval of convergence. 

(a )£>V* (b) XXn)" 


(c) 

(e) £(£)*" 

(g) 


(d) £(fv)x n 

(f) E( (n + 1 ) 22 " ) X 

(h) 


23.2 Repeat Exercise 23.1 for the following: 

(a) Vnx n (b) £ ^x n 

(c) (d )£^* 2n+1 

23.3 Find the exact interval of convergence for the series in Example 6. 

23.4 For n = 0,1,2,3,..., let a n = [ ThgfizfT ]n. 

(a) Find limsup(a rl ) 1 / n , liminf(a rt ) 1/,?1 , limsupl^^-l and liminf 

1 a n I 

(b) Do the series £a n and l) n a n converge? Explain briefly. 


(c) Now consider the power series a nX n with the coefficients a n 
as above. Find the radius of convergence and determine the 
exact interval of convergence for the series. 


23.5 Consider a power series a nX n with radius of convergence R. 

(a) Prove that if all the coefficients a n are integers and if infinitely 
many of them are nonzero, then R < 1. 


(b) Prove thcit if lim sup | ^ 0^ then R ^ 1. 
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23.6 (a) Suppose a nX n has finite radius of convergence R and a n > 0 

for all n. Show that if the series converges at R, then it also 
converges at —R. 

(b) Give an example of a power series whose interval of convergence 
is exactly (—1,1]. 

The next three exercises are designed to show that the notion of 
convergence of functions discussed prior to Example 8 has many 
defects. 

23.7 For each n £ N, let f n (x) = (cosx)". Each f n is a continuous 
function. Nevertheless, show 

(a) lim/ n (x) = 0 unless a: is a multiple of 7r, 

(b) lim/„(x) = 1 if x is an even multiple of 7r, 

(c) lim/ n (x) does not exist if x is an odd multiple of tt. 

23.8 For each n £ N, let f n (x) = ^sinnx. Each f n is a differentiable 
function. Show 

(a) lim/ n (x) = 0 for all x £ M, 

(b) But lim/^(x) need not exist [at x = it for instance]. 

23.9 Let f n {x ) = nx n for x £ [0,1] and n £ N. Show 

(a) limf n (x) = 0 for x £ [0,1). Hint: Use Exercise 9.12. 

(b) However, lim^oo f Q f n (x) dx = 1. 

§24 Uniform Convergence 

We first formalize the notion of convergence discussed prior to 
Example 8 in the preceding section. 

24.1 Definition. 

Let (f n ) be a sequence of real-valued functions defined on a set S C 
K. The sequence (f n ) converges pointwise [i.e., at each point] to a 
function / defined on S if 

lim f n (x ) = f(x) for all x £ S. 

n—>oo 

We often write lim/ n = / pointwise [on S'] or f n —> f pointwise 
[on S]. 
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Example 1 

All the functions / obtained in the last section as a limit of a se¬ 
quence of functions were pointwise limits. See Example 8 of §23 and 
Exercises 23.7-23.9. In Exercise 23.8 we have f n —> 0 pointwise on 
K, and in Exercise 23.9 we have f n —> 0 pointwise on [0,1). □ 

Example 2 

Let f n (x) = x n for x E [0,1]. Then /„ —> f pointwise on [0,1] where 
f(x) = 0 for x E [0,1) and /(1) = 1. □ 

Now observe f n —> f pointwise on S means exactly the following: 

for each e > 0 and x in S there exists N such that , , 

| f n (x) - /(x)| < e for n > N. 

Note the value of N depends on both e > 0 and x in S. If for each 
e > 0 we could find N so that 

| f n (x) — f(x) | < e for all x E S and n > N, 

then the values f n (x) would be “uniformly” close to the values f(x). 
Here N would depend on e but not on x. This concept is extremely 
useful. 

24.2 Definition. 

Let (f n ) be a sequence of real-valued functions defined on a set 
S CM. The sequence (f n ) converges uniformly on S to a function / 
defined on S if 

for each e > 0 there exists a number N such that , . 

| f n (x) — f(x) | < e for all x E S and all n > N. 

We write lim f n = f uniformly on S or f n —»• / uniformly on S. 

Note that if / n —> / uniformly on S and if e > 0, then there exists 
N such that f(x) — e < f n (x) < f(x) + e for all x E S and n > N. 
In other words, for n > N the graph of f n lies in the strip between 
the graphs of / — e and / + e. In Fig. 24.1 the graphs of f n for n > N 
would all lie between the dotted curves. 

We return to our earlier examples. 
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y 



Example 3 

Let f n (x) = (1 — \x\) n for x G (—1,1). Also, let f{x) = 0 for and 
/(0) = 1. As noted in Example 8 of §23, f n —> / pointwise on (—1,1). 
It turns out that the sequence (/„) does not converge uniformly to 
/ on (—1,1) in view of the next theorem. This can also be shown 
directly, as follows. Assume f n —> f uniformly on (—1,1). Then [with 
e = \ in mind] we see there exists N in N so that \f{x) — f n (x)\ < § 
for all x 6 (—1,1) and n > N. Hence 

x € (0,1) and n > N imply |(1 — x) n \ < -. 

In particular, 

x G (0,1) implies (1 — x) N+1 < 

However, this fails for sufficiently small x\ for example, if we set 
x = 1 — 2 ~ 1 / ( A+ 1 ), then 1 — x = 2~ 1 ^ N+1 ' > and (1 — x) N+1 = 2~ 1 = 
This contradiction shows ( f n ) does not converge uniformly to / on 
(—1,1) as had been assumed. □ 

Example 4 

Let f n (x) = L s in nx for x G M. Then f n —> 0 pointwise on M as 
shown in Exercise 23.8. In fact, f n —> 0 uniformly on M. To see this, 
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let e > 0 and let N = Then for n > IV and all x € M we have 


\fn(x) — 0| 


1 1 1 

— sin nx < — < — = e. 
n n N 


□ 


Example 5 

Let f n (x ) = nx 11 for x E [0,1). Since Hindoo / n (l) = lim^oo n = 
+oo, we have dropped the number 1 from the domain under consid¬ 
eration. Then f n —> 0 pointwise on [0,1), as shown in Exercise 23.9. 
We show the convergence is not uniform. If it were, there would exist 
N in N such that 

|nx n — 0| < 1 for all x E [0,1) and n > N. 

In particular, we would have (N + < 1 for all x E [0,1). 

But this fails for x sufficiently close to 1. Consider, for example, the 
reciprocal x of (N + l) 1 /( iV + 1 ). □ 

Example 6 

As in Example 2, let f n (x) = x n for x E [0,1], f(x) = 0 for x E 
[0,1) and /(1) = 1. Then f n —» / pointwise on [0,1], but (/ n ) does 
not converge uniformly to / on [0,1], as can be seen directly or by 
applying the next theorem. □ 

24.3 Theorem. 

The uniform limit of continuous functions is continuous. More pre¬ 
cisely, let (/ n ) be a sequence of functions on a set SCI, suppose 
fn f uniformly on S, and suppose S = dom(/). If each f n is 
continuous at xo in S, then f is continuous at xq. [So if each f n is 
continuous on S, then f is continuous on S.] 

Proof 

This involves the famous argument.” The critical inequality is 

I f{x) - f(x o)| < I f(x) - f n (x)\ + I fn(x) - f n (x 0 )| + \fn(x 0 ) - f (x 0 ) |. 

(1) 

If n is large enough, the first and third terms on the right side of (1) 
will be small, since f n —> f uniformly. Once such n is selected , the 
continuity of f n implies that the middle term will be small provided 
x is close to xq. 
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For the formal proof, let e > 0. There exists N in N such that 
n > N implies | / n (x) — f(x)\ < - for all x € S. 

In particular, 

\f N +i(x) - f(x)\ < - for all xeS. (2) 

Since /n+i is continuous at xo there is a 5 > 0 such that 

x <E S and |x-x 0 |<<5 imply |/jv + i(x) - /jv+i(cc 0 )| < (3) 

see Theorem 17.2. Now we apply (1) with n = N + 1, (2) twice [once 
for x and once for xo] and (3) to conclude 

x € S and \x — xo| <6 imply | f(x) — f{x o)| < 3 • - = e. 

3 

This proves that / is continuous at xq. ■ 


One might think this theorem would be useless in practice, since 
it should be easier to show a single function is continuous than 
to show a sequence ( f n ) consists of continuous functions and the 
sequence converges to / uniformly. This would no doubt be true if 
/ were given by a simple formula. But consider, for example, 


or 


oo 1 

f(x ) = V ~^x n for x G [—1.1] 
z —' n z 


n =1 


Jo(x ) = 


(-i n\x? n 

( n !) 2 

n =0 v ’ 


for x G 


The partial sums are clearly continuous, but neither / nor Jo is given 
by a simple formula. Moreover, many functions that arise in mathe¬ 
matics and elsewhere, such as the Bessel function Jo, are defined by 
power series. It would be very useful to know when and where power 
series converge uniformly; an answer is given in §26. 


24.4 Remark. 

Uniform convergence can be reformulated as follows. A sequence ( f n ) 
of functions on a set S Cl converges uniformly to a function f on 
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S if and only if 

lim sup{| f(x) - f n (x) | :i£S} = 0. (1) 

n—>oo 

We leave the straightforward proof to Exercise 24.12. 

According to (1) we can decide whether a sequence (f n ) con¬ 
verges uniformly to / by calculating sup{|/(x) — f n (x)\ : x € S} for 
each n. If / — f n is differentiable, we may use calculus to find these 
suprema. □ 


Example 7 

Let f n (x ) = 1+ x nx , for Clearly we have lim^oo f n ( 0) = 0. If 

i^O, then lim n _ >00 (l + nx 2 ) = +oo, so lim, woo / n (x) = 0. Thus 
/ n —» 0 pointwise on M. To find the maximum and minimum of f n , 
we calculate f' n {x) and set it equal to 0. This leads to (1 + nx 2 ) ■ 1 
—x(2nx) = 0 or 1 — nx 2 = 0. Thus f' n (x) = 0 if and only if x = ^=. 
Further analysis or a sketch of f n leads one to conclude f n takes its 
maximum at - 4 = and its minimum at —. Since ( ± - 4 = ) = ± ■ 

Vn y/n Jn \ s/n) 2 ^fn' 

we conclude 

lim sup{|/ n (x)| :xGS} = lim —^= = 0. 

n —»oo ih oo ZWn 

Therefore / n —> 0 uniformly on M by Remark 24.4. □ 


Example 8 

Let f n (x) = n 2 x n {l—x) for x £ [0,1]. Then we have lim n _ > . 0O f n ( 1) = 0. 
For x € [0,1) we have lim^oo n 2 x n = 0 by applying Exercise 9.12, 
since for r^O, 

(n + l) 2 x n+1 fn+1 

n 2 x n V n 


v 

I x —> x. 


Hence lim n _ > , 00 f n (x) = 0. Thus f n —» 0 pointwise on [0,1]. Again, to 
find the maximum and minimum of f n we set its derivative equal to 
0. We obtain x n {— 1) + (1 — x)nx 11 ^ 1 = 0 or x n ~ l [n — (n + l)x) = 0. 
Since f n takes the value 0 at both endpoints of the interval [0,1], it 
follows that f n takes it maximum at vxr- We have 


fn 


n 

n + 1 



n 



n \ 
n + 1) 


n 


n + 1 
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The reciprocal of {^W) n is (l + ^) n , the nth term of a sequence which 
has limit e. This was mentioned, but not proved, in Example 3 of §7; 

a proof is given in Theorem 37.11. Therefore we have lim(^-j-) ?l = 

2 

Since limf^jr-] = +oo, we conclude from (1) that lim/ n (^j-) = +oo; 
see Exercise 12.9(a). In particular, limsup{|/ n (a;)| : x € [0,1]} = 
Too, so ( f n ) does not converge uniformly to 0 on [0,1]. □ 

Exercises 

24.1 Let f n (x) = 1+2 ^ nx . Prove carefully that (/„) converges 

uniformly to 0 on R. 

24.2 For x £ [0, oo), let f n (x) = T 

(a) Find f(x) = lim f n (x). 

(b) Determine whether /„ —> f uniformly on [0,1]. 

(c) Determine whether /„—>■/ uniformly on [0, oo). 

24.3 Repeat Exercise 24.2 for f n (x) = 1+ 1 3 , n . 

24.4 Repeat Exercise 24.2 for f n (x) = 1 ^ g;n . 

24.5 Repeat Exercise 24.2 for f n (x) = n + x n ■ 

24.6 Let f n (x) = (x - ^) 2 for x e [0,1]. 

(a) Does the sequence (/„) converge pointwise on the set [0,1]? If 
so, give the limit function. 

(b) Does (f n ) converge uniformly on [0,1]? Prove your assertion. 

24.7 Repeat Exercise 24.6 for f n (x) = x — x n . 

24.8 Repeat Exercise 24.6 for f n (x) = J2k=o xk - 

24.9 Consider f n (x ) = nx n ( 1 — x) for x £ [0,1]. 

(a) Find f(x) = lim/ n (a;). 

(b) Does f n —>f uniformly on [0,1]? Justify. 

(c) Does /q 1 f n ( x ) dx converge to J 0 ' f(x) dxl Justify. 

24.10 (a) Prove that if f n —> f uniformly on a set S, and g n g 
uniformly on S, then f n + 9n^f + 9 uniformly on S. 
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(b) Do you believe the analogue of (a) holds for products? If so, see 
the next exercise. 

24.11 Let f n {x ) = x and g n (x) = 77 for all x £ R. Let f(x) = x and 
g{x) = 0 for x € R. 

(a) Observe /„—>•/ uniformly on R [obvious!] and g n —>■ g 
uniformly on R [almost obvious]. 

(b) Observe the sequence (f n gn) does not converge uniformly to fg 
on R. Compare Exercise 24.2. 

24.12 Prove the assertion in Remark 24.4. 

24.13 Prove that if (/„) is a sequence of uniformly continuous functions 
on an interval (a, 6), and if f n —> f uniformly on (a, 6), then / is 
also uniformly continuous on (a, b). Hint: Try an | argument as in 
the proof of Theorem 24.3. 

24.14 Let f n (x) = 1+ n J. x2 and f{x) = 0 for x £ R. 

(a) Show /„ —► / pointwise on R. 

(b) Does /„—>■/ uniformly on [0,1]? Justify. 

(c) Does /„—>■/ uniformly on [1, 00 )? Justify. 

24.15 Let f n (x) = for x € [0,oo). 

(a) Find f(x) = lim f n (x). 

(b) Does /„—>•/ uniformly on [0,1]? Justify. 

(c) Does /„—>•/ uniformly on [1, 00 )? Justify. 

24.16 Repeat Exercise 24.15 for f n (x) = 1 ^ x2 • 

24.17 Let (/„) be a sequence of continuous functions on [a, b] that con¬ 
verges uniformly to / on [a, b}. Show that if (x n ) is a sequence in 
[a, b} and if x n ->• x, then lim^oo f n (x n ) = f(x). 


§25 More on Uniform Convergence 

Our next theorem shows one can interchange integrals and uni¬ 
form limits. The adjective “uniform” here is important; compare 
Exercise 23.9. 
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25.1 Discussion. 

To prove Theorem 25.2 below we merely use some basic facts about 
integration which should be familiar [or believable] even if your 
calculus is rusty. Specifically, we use: 

(a) If g and h are integrable on [a, b] and if g(x) < h{x ) for all 
x € [a, b], then J^g(x)dx < h(x) dx. See Theorem 33.4(i). 

We also use the following corollary: 

(b) If g is integrable on [a, b], then 


g(x) dx 


< [ I g(x)\dx. 


Continuous functions on closed intervals are integrable, as noted 
in Discussion 19.3 and proved in Theorem 33.2. □ 


25.2 Theorem. 

Let ( f n ) be a sequence of continuous functions on [a,b], and suppose 
fn —^ f uniformly on [a, b\. Then 

fn(x)dx= I f(x) dx. (1) 

J a 

Proof 

By Theorem 24.3 / is continuous, so the functions f n — f are all 
integrable on [a, b]. Let e > 0. Since /„—»•/ uniformly on [a, b ], there 
exists a number N such that \f n (x) — f(x)\ < for all x £ [a, b] 
and all n > N. Consequently n > N implies 


f b 

lim / 
J a 




lfn{x) ~ f(x)} dx 


< I \fn(x) ~ f{x)\dx < 
J a 



6 . 


The first < follows from Discussion 25.1(b) applied to g = f n ~f an d 
the second < follows from Discussion 25.1(a) applied to g = \f n — /] 
and h = rf—', h happens to be a constant function, but this does no 
harm. 

The last paragraph shows that given e > 0, there exists N 
such that | f n (x)dx — f(x)dx\ < e for n > N. Therefore (1) 
holds. ■ 
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Recall one of the advantages of the notion of Cauchy sequence: 
A sequence (s n ) of real numbers can be shown to converge without 
knowing its limit by simply verifying that it is a Cauchy sequence. 
Clearly a similar result for sequences of functions would be valuable, 
since it is likely that we will not know the limit function in advance. 
What we need is the idea of “uniformly Cauchy.” 

25.3 Definition. 

A sequence (/ n ) of functions defined on a set S C M is uniformly 
Cauchy on S if 

for each e > 0 there exists a number N such that , . 

|/n( x) — f m (x) | < e for all x G S and all m,n > N. 

Compare this definition with that of a Cauchy sequence of real 
numbers [Definition 10.8] and that of uniform convergence [Defi¬ 
nition 24.2], It is an easy exercise to show uniformly convergent 
sequences of functions are uniformly Cauchy; see Exercise 25.4. The 
interesting and useful result is the converse, just as in the case of 
sequences of real numbers. 

25.4 Theorem. 

Let ( f n ) be a sequence of functions defined and uniformly Cauchy on 
a set S C K. Then there exists a function f on S such that / n —» / 
uniformly on S. 

Proof 

First we have to “find” /. We begin by showing 

for each xo € S the sequence (f n (x o)) is a Cauchy , , 
sequence of real numbers. ' 

For each e > 0, there exists N such that 

| f n (x) — fm(x) | < e for x E S and m,n > N. 

In particular, we have 

\fn(xo) ~ fm(x o)| < e for m, n > N. 

This shows (f n (x o)) is a Cauchy sequence, so (1) holds. 
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Now for each x in S, assertion (1) implies lim n _ 5 . 0O f n (x) exists; 
this is proved in Theorem 10.11 which in the end depends on the 
Completeness Axiom 4.4. Hence we define f(x) = linv^oo f n (x). 
This defines a function f on S such that f n —> f pointwise on S. 

Now that we have “found” /, we need to prove f n ~^f uniformly 
on S. Let e > 0. There is a number N such that 

| f n (x) — f m (x)\ < - for all igS and all m,n > N. (2) 

Consider m > N and x E S. Assertion (2) tells us that f n (x) lies in 
the open interval (f m (x) — |,/ m .(x) + |) for all n > N. Therefore, 
as noted in Exercise 8.9, the limit f(x) = liiUn^oo f n (x) lies in the 
closed interval [f m (x) — |, f m ( x ) + §]• In other words, 

|/(.x) — fm(x )| < - for all x 6 S and m > N. 

Then of course 

| f(x) — fm{x) | < e for all and m > N. 

This shows f m —> f uniformly on S, as desired. ■ 


Theorem 25.4 is especially useful for “series of functions.” Let us 
recall what XlfcLi a k signifies when the a^’s are real numbers. This 
signifies lim^oo Ylk=i a k provided this limit exists [as a real number, 
Too or — oo]. Otherwise the symbol ak has no meaning. Thus 

the infinite series is the limit of the sequence of partial sums Ylk =i a k- 
Similar remarks apply to series of functions. A series of functions is 
an expression 9k or Y^k=o9k{.x) which makes sense provided 

the sequence of partial sums Ylk=o9k converges, or diverges to Too 
or — oo pointwise. If the sequence of partial sums converges uniformly 
on a set S to Ylk^o then we say the series is uniformly convergent 
on S. 


Example 1 

Any power series is a series of functions, since a k xk h as the 

form Y,T=o 9k where fl'fc(x) = akX k for all x. □ 
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y 



FIGURE 25.1 


Example 2 

YlT=o i+x k * s a ser i es °f functions, but is not a power series, at least 

not in its present form. This is a series YlkLoSk w h ere 9o( x ) = \ f° r 

2 

all x. gi(x) = for all x, g-Ax) = for all x, etc. □ 


Example 3 

Let g be the function drawn in Fig. 25.1, and let g n (x ) = g(4Tx) for 
all x € M. Then Yl™=o(l) n 9n( x ) a ser i es °f functions. The limit 
function / is continuous on M, but has the amazing property that it is 
not differentiable at any point! The proof of the nondifferentiability 
of / is somewhat delicate; see [62, 7.18]. A similar example is given 
in Example 38.1 on page 348. □ 


Theorems for sequences of functions translate easily into theo¬ 
rems for series of functions. Here is an example. 

25.5 Theorem. 

Consider a series YlkL o 9k of functions on a set S C M. Suppose 
each gk is continuous on S and the series converges uniformly on S. 
Then the series 9k represents a continuous function on S. 

Proof 

Each partial sum f n = Ylk=i 9k is continuous and the sequence (f n ) 
converges uniformly on S. Hence the limit function is continuous by 
Theorem 24.3. ■ 
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Recall the Cauchy criterion for series 22 a k given in Defini¬ 
tion 14.3: 

for each e > 0 there exists a number N such that 
n > m > N implies | 22fc =m ®fc| < e - 

The analogue for series of functions is also useful. The sequence of 
partial sums of a series 22 a*Lo 9k of functions is uniformly Cauchy 
on a set S if and only if the series satisfies the Cauchy criterion 
[■uniformly on S']: 

for each e > 0 there exists a number N such that 
n > m > N implies | J2k=m 9k( x ) I < e for all x € S. 

25.6 Theorem. 

If a series 22^Lo 9k °f functions satisfies the Cauchy criterion 
uniformly on a set S, then the series converges uniformly on S. 

Proof 

Let f n = Ylk=o9k- The sequence (f n ) of partial sums is uni¬ 
formly Cauchy on S, so (/ n ) converges uniformly on S by 
Theorem 25.4. ■ 

Here is a useful corollary. 

25.7 Weierstrass M-test. 

Let (Mk) be a sequence of nonnegative real numbers where 22 Mk < 
oo. If \gk( x )\ < Mk for all x in a set S, then 22 9k converges 
uniformly on S. 

Proof 

To verify the Cauchy criterion on S, let e > 0. Since the series 22 Mk 
converges, it satisfies the Cauchy criterion in Definition 14.3. So there 
exists a number N such that 

n 

n > m > N implies Mk < e. 

k=m 

Hence if n > m > N and x is in S, then 

n n n 

^2 9k(x ) < ^22 \9k( x )\ <^22M k < e. 

k=m k=m k=m 
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Thus the series ^ g/ c satisfies the Cauchy criterion uniformly on S, 
and Theorem 25.6 shows it converges uniformly on S. ■ 

Example 4 

Show 2~ n x n represents a continuous function / on (—2, 2), but 

the convergence is not uniform. □ 


Solution 

This is a power series with radius of convergence 2. Clearly the series 
does not converge at x = 2 or at x = —2, so its interval of convergence 
is (-2,2). 

Consider 0 < a < 2 and note 2 -n a n = Yin-. Li(§) n con- 

verges. Since \2~ n x n \ < 2 ~ n a n = (|) n for x 6 [—a, a], the Weierstrass 
M -test 25.7 shows the series 2~ n x n converges uniformly to a 

function on [—a, a]. By Theorem 25.5 the limit function / is contin¬ 
uous at each point of the set [—a, a]. Since a can be any number less 
than 2, we conclude / represents a continuous function on (—2, 2). 

Since we have sup{|2 _n .x n | : x E (—2,2)} = 1 for each n, the 
convergence of the series cannot be uniform on (—2, 2) in view of the 
next example. □ 


Example 5 

Show that if the series ^ g n converges uniformly on a set S, then 


lim sup{|<? n (x)| : x E S} = 0. 

n—>oo 




Solution 

Let e > 0. Since the series g n satisfies the Cauchy criterion, there 
exists N such that 


n > m > N implies 
In particular, 


n 

9k(x) 

k=m 


< e 


for all x E S. 


n > N implies \g n (x)\ < e for all x E S. 


Therefore 


n > N implies sup{|g n (x)| : x E S} < e. 
This establishes (1). 


□ 
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Exercises 


25.1 

25.2 

25.3 


25.4 

25.5 

25.6 

25.7 

25.8 

25.9 

25.10 


25.11 


Derive Discussions 25.1(b) from 25.1(a). Hint: Apply (a) twice, once 
to g and |<?| and once to — |p| and g. 

Let f n (x ) = Show (/„) is uniformly convergent on [—1,1] and 
specify the limit function. 

Let f n (x) = 2 "^°n 2 3: 3 . for all real numbers x. 

(a) Show (/„) converges uniformly on R. Hint: First decide what 
the limit function is; then show (/„) converges uniformly to it. 

(b) Calculate lim^oo fj f n (x) dx. Hint: Don’t integrate f n . 

Let (/„) be a sequence of functions on a set S C R, and suppose 
/„ —> / uniformly on S. Prove (/„) is uniformly Cauchy on S. Hint: 
Use the proof of Lemma 10.9 on page 63 as a model, but be careful. 

Let (f n ) be a sequence of bounded functions on a set S, and suppose 
fn—tf uniformly on S. Prove / is a bounded function on S. 

(a) Show that if X7 l a fc| < °°i then 52 a,kX k converges uniformly on 
[— 1 , 1 ] to a continuous function. 

(b) Does 5257=1 ^2 x n represent a continuous function on [—1, 1]? 

Show 5257=1 ^y-cosna? converges uniformly on I to a continuous 
function. 

Show 52557=1 ^§ 2 ^ has radius of convergence 2 and the series 
converges uniformly to a continuous function on [—2,2]. 

(a) Let 0 < a < 1. Show the series 52757=0 converges uniformly 
on [-a, a] to 

(b) Does the series 52557=o xU conver g e uniformly on (—1,1) to y2y? 
Explain. 

(a) Show 52 i+ x n converges for x G [0,1). 

(b) Show that the series converges uniformly on [0,a] for each a, 
0 < a < 1 . 

(c) Does the series converge uniformly on [0,1)? Explain. 

(a) Sketch the functions go, g i, 32 and 33 in Example 3. 

(b) Prove the function / in Example 3 is continuous. 
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25.12 Suppose 9k is a series of continuous functions gu on [a, 6 ] that 

converges uniformly to g on [a, 5]. Prove 



25.13 Suppose 9k and 52fcLi bk converge uniformly on a set S. Show 
SfcLi (9k + hk) converges uniformly on S. 

25.14 Prove that if converges uniformly on a set S and if ft is a 

bounded function on S, then 52 hgk converges uniformly on S. 

25.15 Let (/„) be a sequence of continuous functions on [a, ft]. 

(a) Suppose that, for each x in [a, 6 ], (/„( x)) is a decreasing se¬ 
quence of real numbers. Prove that if fn —*■ 0 pointwise on 
[a, ft], then /„ —*■ 0 uniformly on [a, b\. Hint: If not, there exists 
e > 0 and a sequence (x n ) in [a, ft] such that f n {x n ) > e for all 
n. Obtain a contradiction. 

(b) Suppose that, for each x in [a, b], is a n increasing se¬ 

quence of real numbers. Prove that if f n —> f pointwise on [a, b] 
and if / is continuous on [a, ft], then /„—>■/ uniformly on [a, 6 ]. 
This is Dini’s theorem. 

§26 Differentiation and Integration of Power 
Series 

The following result was mentioned in §23 after Example 8 . 

26.1 Theorem. 

Let o a nX n be a power series with radius of convergence R > 0 

[possibly R = +oo]. If 0 < R\ < R, then the power series converges 

uniformly on [—to a continuous function. 


Proof 


Consider 0 < R\ < R. A glance at Theorem 23.1 shows the se¬ 
ries Yl a nX n and \ a n\x n have the same radius of convergence, 
since (3 and R are defined in terms of |a n |. Since |i?i| < R, we 
have ^2 \ a n\R\ < oo. Clearly we have |o n .x n | < \a n \Rf for all x in 
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[— Ri, R\], so the series 22 a n x n converges uniformly on [—Ri, i?i] by 
the Weierstrass M-test 25.7. The limit function is continuous at each 
point of [— Ri,R\] by Theorem 25.5. ■ 

26.2 Corollary. 

The power series 22 a n xU converges to a continuous function on the 
open interval (—R,R). 

Proof 

If xo £ (— R, R), then xq £ (— Ri, Ri) for some R\ < R. The theorem 
shows the limit of the series is continuous at xq. ■ 

We emphasize that a power series need not converge uniformly 
on its interval of convergence though it might; see Example 4 of §25 
and Exercise 25.8. 

We are going to differentiate and integrate power series term- 
by-term, so clearly it would be useful to know where the new series 
converge. The next lemma tells us. 

26.3 Lemma. 

If the power series 22^1o a nX n has radius of convergence R, then the 
power series 

oo oo 

na n x n ~ l and S' _fr_ x n + 1 

^ ^ n + 1 

n=1 n=0 

also have radius of convergence R. 

Proof 

First observe the series s f2,na n x n ~ 1 and 'Yfna n x n have the same ra¬ 
dius of convergence: since the second series is x times the first series, 
they converge for exactly the same values of x. Likewise 22 n +i xn+1 
and 22 £+r xTl have the same radius of convergence. 

Next recall R = jj where /3 = limsup \a n \ l / n . For the se¬ 
ries 22 ™ n s n , we consider limsup(n|a n |) 1 / n = lirrisup n 1 \a n \ x / n . 

By Theorem 9.7(c) on page 48, we have limn 1 /™ = 1, so 

limsup(n|a n |) 1//n = (3 by Theorem 12.1 on page 78. Hence the series 
22 na n x n has radius of convergence R. 
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For the series we consider limsup(^p]-) 1//n . It is easy 

to show lim(n + l) 1 /* 1 = 1; therefore lim(^q-j-) 1 /” = 1. Hence by 

Theorem 12.1 we have hmsup(J^pj-) 1 / n = /3, so the series ^+l xU 
has radius of convergence R. ■ 


26.4 Theorem. 

Suppose f(x) = a nX n has radius of convergence R > 0. Then 

px oo 

/ f(t) dt = Y an x n+1 for |x| < R. (1) 

h n+l 

Proof 

We fix x and assume x < 0; the case x > 0 is similar [Exercise 26.1]. 
On the interval [x, 0], the sequence of partial sums Yl'k=o a k^ k 
converges uniformly to /(f) by Theorem 26.1. Consequently, by 
Theorem 25.2 we have 



The second equality is valid because we can interchange integrals 
and finite sums; this is a basic property of integrals [Theorem 33.3]. 
Since J'J f(t ) dt = — f(t) dt , Eq. (2) implies Eq. (1). ■ 

The theorem just proved shows that a power series can be inte¬ 
grated term-by-term inside its interval of convergence. Term-by-term 
differentiation is also legal. 

26.5 Theorem. 

Let /(x) = En=o a nX n have radius of convergence R > 0. Then f is 
differentiable on (-R, R) and 

OO 

f\x ) = na n x n ~ l for |x| < R. 

71=1 


( 1 ) 
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The proof of Theorem 26.4 was a straightforward application of 
Theorem 25.2, but the direct analogue of Theorem 25.2 for deriva¬ 
tives is not true [see Exercise 23.8 and Example 4 of §24], So we give 
a devious indirect proof of the theorem. 


Proof 

We begin with the series g{x) = Y^=i na nX n ^ 1 and observe this 
series converges for |x| < R by Lemma 26.3. Theorem 26.4 shows 
that we can integrate g term-by-term: 



OO 

y ^an,x n 

n=l 


f(x) — a o for |x| < R. 


Thus if 0 < R\ < R, then 

f(x) = I g{t)dt + k for |ar| < Ri, 

J-Ri 

where A: is a constant; in fact, k = ao — g(t ) dt. Since g is contin¬ 
uous, one of the versions of the Fundamental Theorem of Calculus 
[Theorem 34.3] shows / is differentiable and f'{x ) = g(x). Thus 

OO 

f'(x) = g{x) = na n x n ~ l for \x\ < R. 

n =1 h 


Example 1 

Recall 


E 


x n = 


1 


n =0 


1 — X 

Differentiating term-by-term, we obtain 
~ 1 


for |x| < 1. 


E 

n= 1 


nx 11 1 = 


(1 — x ) 2 


for Ixl < 1. 


Integrating (1) term-by-term, we get 


( 1 ) 


^ 1 f‘X 1 

E^TT X " +I = l = 

n =0 
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or 



n =1 


Replacing x by —x, we find 



It turns out that this equality is also valid for x = 1 [see Example 2] , 
so we have the interesting identity 



( 4 ) 


In Eq. (2) set x = Then 



n 



m — 1 


log e 1 


log e m. 


m 


Hence we have 



for all m. 


Here is yet another proof that = +c»- 


□ 


To establish (4) we need a relatively difficult theorem about 
convergence of a power series at the endpoints of its interval of 
convergence. 

26.6 Abel’s Theorem. 

Let f(x) = a nX n be a power series with finite positive radius of 

convergence R. If the series converges atx = R, then f is continuous 
at x = R. If the series converges at x = —R, then f is continuous 
at x = —R. 


Example 2 

As promised, we return to (3) in Example 1: 
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For x = 1 the series converges by the Alternating Series Theo¬ 
rem 15.3. Thus the series represents a function / on (—1,1] that is 
continuous at x = 1 by Abel’s theorem. The function log e (l + x) 
is also continuous at x = 1 , so the functions agree at a: = 1 . 
[In detail, if ( x n ) is a sequence in ( — 1,1) converging to 1, then 
/(1) = lim^oo f(x n ) = linin^oo log e (l + x n ) = log e 2.] Therefore 
we have 


log e 2 = 1 



1 

4 


1 

5 


1 

6 


+ ■■■. 


Another proof of this identity is given in Example 2 of §31. □ 


Example 3 

Recall En=o xn = l° r M < 1- Note that at x = — 1 the function 
is continuous and takes the value However, the series does 
not converge for x = —1. so Abel’s theorem does not apply. □ 


Proof of Abel’s Theorem 

The heart of the proof is in Case 1. 

Case 1. Suppose f(x) = Yl‘^Lo a nX n has radius of convergence 1 
and the series converges at x = 1. We will prove / is continuous 
on [0,1]. By subtracting a constant from /, we may assume /(1) = 
o a n = 0. Let f n {x) = Efc=o a kX k and s n = EEo a k = fn{ 1) 
for n = 0,1, 2 ,.... Since f n (x) f(x) pointwise on [0,1] and each 
f n is continuous, Theorem 24.3 on page 196 shows it suffices to show 
f n —> f uniformly on [0,1]. Theorem 25.4 on page 202 shows it 
suffices to show the convergence is uniformly Cauchy. 

For m < n, we have 


fn{x) - f m {x ) 


n n 

^2 akX k = 22 ( Sfc “ s k-i)x k 

k=m -\-1 k=m -\-1 

n n 

22 s kX k -X 22 S k-lX k ~ 1 

k=m -\-1 k=m J rl 

n n— 1 

22 Skxk ~ x 22 Skxk ’ 

k=m -\-1 k=m 
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and therefore 


71—1 


fn(x) - f m (x) = S n X n - S m X m+1 + (1 - X) ^ S k X k . 

k=m +1 


(i) 


Since lim s n = a k = /(l) = 0, given e > 0, there is an integer N 

so that |s n | < | for all n > N. Then for n > m > N and x in [0,1), 
we have 


n— 1 

(! - x ) ^2 Skxh 
k=m+l 


< -(i 
“ 3 v 


71—1 

x) ^ x 

k=m +1 


k 


a 1 _ 1 , 

= In _ x )x m+1 - _-_ < - 

3 1 X)X 1-x S' 


(2) 


The first term in inequality (2) is also less than | for x = 1. 
Therefore, for n > m > N and x in [0,1], (1) and (2) show 

I fn{x) - fm{x) I < \Sn\x 11 + |s m |x m+1 + |<|+^ + ^=e. 

Thus the sequence (f n ) is uniformly Cauchy on [0,1], and its limit 
/ is continuous. 


Case 2. Suppose f(x) = a nX n has radius of convergence R, 

0 < R < oo, and the series converges at x = R. Let g(x) = f(Rx) 
and note that 

OO 

g(x ) = ^a n l? Tl x n for |x| < 1 . 

71—0 

This series has radius of convergence 1, and it converges at x = 1. 
By Case 1, g is continuous at x = 1. Since f(x) = g(^), it follows 
that / is continuous at x = R. 

Case 3. Suppose f(x) = a nX n has radius of convergence R, 

0 < R < oo, and the series converges at x = —R. Let h(x) = f(—x) 
and note that 

OO 

h(x ) = y~^(—1 ) n a n x n for |x| < R. 

71=0 

The series for h converges at x = R, so h is continuous at x = R by 
Case 2. It follows that f(x) = h(—x) is continuous at x = —R. _ 
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The point of view in our extremely brief introduction to power 
series has been: For a given power series ^2 a nX n , what can one say 
about the function f(x) = 22 a n x n ? This point of view was mis¬ 
leading. Often, in real life, one begins with a function / and seeks a 
power series that represents the function for some or all values of x. 
This is because power series, being limits of polynomials, are in some 
sense basic objects. 

If we have f(x) = 22^o a nX n for |x| < R, then we can differenti¬ 
ate / term-by-term forever. At each step, we may calculate the fcth 
derivative of / at 0, written f^ k \ 0). It is easy to show /( fc )(0) = k\ak 
for k > 0. This tells us that if f can be represented by a power series, 
then that power series must be JJkLo xk ■ This is the Taylor se¬ 
ries for / about 0. Frequently, but not always, the Taylor series will 
agree with / on the interval of convergence. This turns out to be 
true for many familiar functions. Thus the following relations can be 
proved: 


oo 


k =0 


COSX = 


E 

k =0 


1)k x 2k , 


(2k) 


sinx = 


oo 


E 


(~ 1 ) A ' 2fc+l 

(2k + 1 )! 


for all x in M. A detailed study of Taylor series is given in §31. 


Exercises 

26.1 Prove Theorem 26.4 for x > 0. 

26.2 (a) Observe 222E nxn = (i-x) 2 f° r M < T see Example 1. 

(b) Evaluate 222Li -pr- Compare with Exercise 14.13(d). 

(c) Evaluate £2 Li §, and 

26.3 (a) Use Exercise 26.2 to derive an explicit formula for 222 Li n 2 x n . 
(b) Evaluate £^=i If and E2°=i fk- 

26.4 (a) Observe e~ x2 = 222L o ( ~V x 2n for £ S R, since we have e x = 

E2E fOT * e R. 

(b) Express F(x) = f (J ' e * 2 dt as a power series. 
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26.5 Let fix) = E^L o f° r x e Show f = /. Do not use the fact 
that f{x) = e x \ this is true but has not been established at this point 
in the text. 

26.6 Let s(x) = x — ^ ^ — ■ ■ ■ and c(x) = 1 — — • • • for x G R. 

(a) Prove s' = c and d = — s. 

(b) Prove ( s 2 + c 2 )' = 0. 

(c) Prove s 2 + c 2 = 1. 

Actually s(x) = sin a: and c{x) = cosx , but you do not need these 
facts. 

26.7 Let f{x) = \x\ for x £ R. Is there a power series J f l d n x n such that 

f{x) = a nX n for all xl Discuss. 

26.8 (a) Show E“=o( i r x2n = for x £ (-1,1). Hint : E^=o V™ = 

. Let w = —x 2 . 

1-!/ y 

(b) Show arctanx = E^o 2n+i x 2n+1 f° r x 6 (— 1,1). 

(c) Show the equality in (b) also holds for x = 1. Use this to find a 
nice formula for 7r. 

(d) What happens at x = — 1? 


§27 * Weierstrass’s Approximation Theorem 

Suppose a power series has radius of convergence greater than 1, and 
let / denote the function given by the power series. Theorem 26.1 
tells us that the partial sums of the power series get uniformly close 
to / on [—1,1]. In other words, / can be approximated uniformly 
on [—1,1] by polynomials. Weierstrass’s approximation theorem is 
a generalization of this last observation, for it tells us that any 
continuous function on [—1,1] can be uniformly approximated by 
polynomials on [—1,1]. This result is quite different because such a 
function need not be given by a power series; see Exercise 26.7. The 
approximation theorem is valid for any closed interval [a, b] and can 
be deduced easily from the case [0,1]; see Exercise 27.1. 

We give the beautiful proof due to S. N. Bernstein. Bernstein 
was motivated by probabilistic considerations, but we will not use 
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any probability here. One of the attractive features of Bernstein’s 
proof is that the approximating polynomials will be given explicitly. 
There are more abstract proofs in which this is not the case. On the 
other hand, the abstract proofs lead to far-reaching and important 
generalizations. See the treatment in [31] or [62], 

We need some preliminary facts about polynomials involving 
binomial coefficients. 


27.1 Lemma. 

For every igR and n > 0, we have 

Proof 

This is just the binomial theorem [Exercise 1.12] applied to a = x 
and b = 1 — x, since in this case (a + b) n = l n = 1. ■ 


27.2 Lemma. 

For and n > 0, we have 

^(ni — k) 2 ( r ^\x k (l — x) n ~ k = nx( 1 — x) < (1) 

fc=o ' ' 

Proof 

Since = n(^2i) for k> 1, we have 


k =o 




- x ) n ~ k = n 




k= 1 
n— 1 

= nx 

3=0 

= nx. 

n—2 


n—k 


n — 1 


x\l — x) 


n—l—j 


( 2 ) 


Since k{k — 1)(^) = n{n — 1)(^_ 2 ) for & > 2, we have 


2-2 


E Hk ~ 1) ( J x k (l - x) n ~ k = n{n - l)x- 2 ]T 

fc=0 ' ' j= 0 

= n(n — l)x 2 . 


n—2 

j 


x j {l-x) n ~ 2 - j 

(3) 
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Adding the results in (2) and (3), we find 

k 2 f 7 f\x k (l — x) n ~ k = n(n — 1 )x 2 + nx = n 2 x 2 + nx(l — x). (4) 
k =o ' 7 

Since ( nx — k ) 2 = n 2 x 2 — 2nx-k + kr, we use Lemma 27.1, (2) and (4) 
to obtain 

V(na; — fc) 2 ^ ^)x fc (l — x) n ~ k = n 2 x 2 — 2 nx(nx) + [n 2 x 2 + nx(l — x)] 
k =0 ' ' 

= nx{ 1 — x). 

This establishes the equality in (1). The inequality in (1) simply 
reflects the inequality x(l — x) < -g, which is equivalent to 4x 2 — 4x + 
1 > 0 or (2x - l) 2 >0. ■ 

27.3 Definition. 

Let / be a function defined on [0,1]. The polynomials B n f defined 
by ' 

k =0 V 7 V 7 

are called Bernstein polynomials for the function /. 

Here is Bernstein’s version of the Weierstrass approximation 
theorem. 

27.4 Theorem. 

For every continuous function f on [0,1], we have 
B n f —> f uniformly on [0,1]. 


Proof 

We assume / is not identically zero, and we let 
M = sup{|/(x)| : x G [0,1]}. 

Consider e > 0. Since / is uniformly continuous by Theorem 19.2, 
there exists S > 0 such that 

x,ye[ 0,1] and \x - y\ < 5 imply \f(x) - f(y)\ < |. (1) 
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Let N = Alj. This choice of N is unmotivated at this point, but we 
make it here to emphasize that it does not depend on the choice of x. 
We will show 

| B n f{x) — f{x) | < e for all x G [0,1] and all n > N, (2) 

completing the proof of the theorem. 

To prove (2), consider a fixed x G [0,1] and n > N. In view of 
Lemma 27.1, we have 


k =0 ' ' 


SO 


I Bnf(x) ~ f(x) | < 


k =0 




x k (l — x) 


n—k 


( 3 ) 


To estimate this sum, we divide the set {0, 1,2,... ,n} into two sets: 

> S. 

n 

For k & A we have |/(^) — f(x )| < | by (1), so 


ke A if 

k 

- x 

< 8 while k G B if 

k 

- x 


n 


n 


E 

k£A 


f ( \ ) - /(*) 


n 


x k (\-x) 


n—k 


£ E 

k£A 


e in 

2 U 


x fc (l-x) n “ fc < | 


( 4 ) 


using Lemma 27.1. For k G B, we have 
n 2 <5 2 , so 


I k—nx | 


> (5 or (& — n.x) 2 > 


E 

fce-B 


/I^F/w 


k&B 

By Lemma 27.2, this is bounded by 
2 M n 


\x k (l-x) n ~ k <2 MV -x) n - fc 

' fce-B ' ^ 

R a / 


M M 
< 


n 2 8 2 4 2n<5 2 2iV5 2 
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This observation, (4) and (3) show 

l-Bn/0) - fix) | < e. 

That is, (2) holds. ■ 

27.5 Weierstrass’s Approximation Theorem. 

Every continuous function on a closed interval [a, b] can be uniformly 
approximated by polynomials on [a, b]. 

In other words, given a continuous function / on [a, 6], there exists 
a sequence (p n ) of polynomials such that p n —* / uniformly on [a, 6]. 

27.6 Corollary. 

Given a continuous function f on [a,b], there exists a sequence (p n ) 
of polynomials such that p n —» f uniformly on [a, b], and for each n, 
Pn(a) = f(a) and p n (b) = f{b). 

Proof 

See Exercise 27.4. ■ 


Exercises 

27.1 Prove Theorem 27.5 from Theorem 27.4. Hint: Let cf>(x ) = (b—a)x+a 
so that cf) maps [0,1] onto [a, b]. If / is continuous on [a, b ], then f ocj) 
is continuous on [0,1]. 

27.2 Show that if / is continuous on R, then there exists a sequence ( p n ) 
of polynomials such that p n —> / uniformly on each bounded subset 
of R. Hint: Arrange for \f(x) — p n (x)\ < - for \x\ < n. 

27.3 Show there does not exist a sequence of polynomials converging 
uniformly on R to / if 

(a) f(x) = sinx, (b) f(x) = e x . 

27.4 Prove Corollary 27.6. Hint: Select a sequence ( q n ) of polynomials such 
that q n > f uniformly on [a, b\. For each n, let s n be the function 
on R whose graph is the straight line passing through the points 
(a, /(a) - q n {a )) and (6, f(b) - q n (b)). Set p n = q n + s n . 

27.5 Find the sequence ( B n f) of Bernstein polynomials in case 

(a) f(x) = x, (b) f(x) = x 2 . 
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27.6 The Bernstein polynomials were defined for any function / on [0,1]. 
Show that if B n f —> / uniformly on [0,1], then / is continuous 
on [0,1]. 

27.7 Let / be a bounded function on [0,1], say |/(ar)| < M for all x £ [0,1]. 
Show that all the Bernstein polynomials B n f are bounded by M. 



Differentiation 



CHAPTER 


In this chapter we give a theoretical treatment of differentiation and 
related concepts, most or all of which will be familiar from the stan¬ 
dard calculus course. Three of the most useful results are the Mean 
Value Theorem which is treated in §29, L’Hospital’s Rule which is 
treated in §30, and Taylor’s Theorem which is given in §31. 


§28 Basic Properties of the Derivative 

The reader may wish to review the theory of limits treated in §20. 


28.1 Definition. 

Let / be a real-valued function defined on an open interval containing 
a point a. We say / is differentiable at a, or f has a derivative at a, 
if the limit 


lim 

x^f-a 


f(x) - f(a) 
x — a 


K.A. Ross, Elementary Analysis: The Theory of Calculus, 
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exists and is finite. We will write f'(a) for the derivative of / at a: 


/'(«) 


lint 

x^a 


f(x) - f{a) 
x — a 


(1) 


whenever this limit exists and is finite. 


Generally speaking, we will be interested in f as a function in 
its own right. The domain of f is the set of points at which / is 
differentiable; thus dom(/') C dom(/). 


Example 1 

The derivative of the function g(x) = x 2 at x = 2 was calculated in 
Example 2 of §20: 

x 2 — 4 

g'(2 ) = lim - = lim (a; + 2) = 4. 

x—>2 X 2 x—>2 

We can calculate g'(a) just as easily: 

X 2 — CL 2 

g'(a ) = lim-= lim (x + a) = 2a. 

2 —Hi x — a x—Hi 


This computation is even valid for a = 0. We may write g'{x) = 2x 
since the name of the variable a or x is immaterial. Thus the deriva¬ 
tive of the function given by g(x) = x 2 is the function given by 
g'{x) = 2x, as every calculus student knows. □ 


Example 2 

The derivative of h(x) = \Jx at x - 
of §20: h'( 1) = In fact, h(x) = x 
for x > 0; see Exercise 28.3. 


= 1 was calculated in Example 3 
l,/2 for x > 0 and h'(x) = \x~ x ^ 2 

□ 


Example 3 

Let n be a positive integer, and let f(x) = x n for all iGl. We show 
f'(x) = nx n ~ l for all Fix a in M and observe 

j(x) — j{a) = x —a = (x—a)(x +ax +a x +■■■-!-a x+a ), 


SO 


f{x) - /(a) 


= X 


n— 1 


ax n ~ 2 + a 2 x n ~ 3 + • • • + a n ~ 2 x + a’ 1 " 1 


x — a 
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for x 7 ^ a. It follows that 
f(x) - f(a) 


f\a ) = lim 


= a 


x—>a 
n— 1 


x — a 

+ aa n ~ 2 + aV " 3 + 


+ a n ~ 2 a + a n_1 = na n_1 ; 


we are using Theorem 20.4 and the fact that lim x _>. a x k = a k for k 
in N. □ 

We first prove differentiability at a point implies continuity at 
the point. This may seem obvious from all the pictures of familiar 
differentiable functions. However, Exercise 28.8 contains an example 
of a function that is differentiable at 0 and of course continuous at 
0 [by the next theorem], but is discontinuous at all other points. 

28.2 Theorem. 

If f is differentiable at a point a, then f is continuous at a. 

Proof 

We are given f'(a ) = lim^a , and we need to prove 

li m x ^ a f(x) = f(a). We have 

f{x) = (x- a) -b /(a) 

x — a 

for x £ dom(/), x ^ a. Since lim x ^ a (x — a) = 0 and lim x ^. a 
exists and is finite, Theorem 20.4(h) shows lim x ^ a (x — a)- 
f(x)-f( a ) _ q Therefore lim X ^. a f(x) = /(a), as desired. ■ 


We next prove some results about sums, products, etc. of deriva¬ 
tives. Let us first recall why the product rule is not ( fg )' = f g' 
[as many naive calculus students wish!] even though the product of 
limits does behave as expected: 


lim(/i/ 2 )(x) = lim fi(x) 

x^a L x^a 


lim f 2 {x ) 


provided the limits on the right side exist and are finite; see Theo¬ 
rem 20.4(h). The difficulty is that the limit for the derivative of the 
product is not the product of the limits of the derivatives, i.e., 

f{x)g{x) - f{a)g(a ) ^ f{x) - /(a) _ g{x) - g{a ) 


x — a 


x — a 


x — a 
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The correct product rule is obtained by shrewdly writing the left 
hand side in terms of and as hi the proof of 

Theorem 28.3(iii) below. 


28.3 Theorem. 

Let f and g be functions that are differentiable at the point a. Each of 
the functions cf [c a constant ], f+g, fg and f /g is also differentiable 
at a, except f /g if g(a) = 0 since f /g is not defined at a in this case. 
The formulas are 

(i) (cf)'(a) = c ■ /'(a); 

(ii) (/ + sO'(a) = /'( a ) + s'{a)\ 

(iii) [product rule] (fg)'{a) = f(a)g' (a ) + f{a)g{a ); 

(iv) [quotient rule] (f/g)'(a) = [g(a)f(a ) - f(a)g'(a)]/g 2 (a ) if 

g(a) + o. 


Proof 

(i) By definition of cf we have (c/)(x) = c • f(x) for all x € 
dom(/); hence 

( rw i- ( c f)( x ) ~ ( c /)(«) v f(x)-f{a) , 

(cf) (a) = Inn - = lim c -= c-f (a). 

x^>a X — a x^ra x — a 

(ii) This follows from the identity 

(f + 9 )(x) ~ (/ + 9 )(a) = f(x) ~ f(a ) + g(x) - g(a) 


x — a 


x — a 


x — a 


upon taking the limit as x —> a and applying Theorem 20.4(i). 
(iii) Observe 

(/fOO) - (/s)(a) = f^ g(x)-g(a) , g ^f( x ) ~ /( a ) 


x — a 


x — a 


x — a 


for x E dom(/g), x a. We take the limit asr-Hi and note 
that lim x -> a f(x) = /(a) by Theorem 28.2. We obtain [again 
using Theorem 20.4] 

(fg)'(a) = f(a)g\a)+g(a)f'(a). 

(iv) Since g(a) 0 and g is continuous at a, there exists an open 
interval I containing a such that g(x) 0 for x E I. For x E / 
we can write 
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if/g)(x) - ( f/g)(a ) 


fjx) _ ffaf = g{a)f{x) - f(a)gjx) 
g(x) g(a) g(x)g(a) 

g(a)f(x) - g(a)f(a) + ff(a)/(a) - f(a)g(x) 
gix)g(a) 


so 


(//s)(z) - (f/g)(a) 


x — a 


= i 9(a) 


fix) - f(a) 


x — a 


~ /(a) 


g(x) - g{a) 


x — a 


1 


g(x)g(a) 


for x €l I, x ^ a. Now we take the limit as i -i a to obtain 
(iv); note that lim*-*, ■ 


Example 4 

Let m be a positive integer, and let h(x) = x~ m for i ^ 0. Then 
h(x) = f(x)/g(x) where f(x) = 1 and g{x) = x m for all x. By the 
quotient rule, 


iu \ 9{o)f'{a) ~ f(a)g'{a ) a m ■ 0 - 1 • mod 

h (°) = - 2 T~\ - = - 2 ^- 

<7 z (a) cr m 


ixi _ m —i 

= -ma 


a 


m +1 


for a 7 ^ 0. If we write n for —to, then we see the derivative of x n 
is nx n ~ l for negative integers n as well as for positive integers. The 
result is also trivially valid for n = 0. For fractional exponents, see 
Exercise 29.15. □ 


28.4 Theorem [Chain Rule]. 

If f is differentiable at a and g is differentiable at /(a), then the 
composite function gof is differentiable at a and we have (gof)'(a) = 
g'(f(a))-f(a). 

Discussion. Here is a faulty “proof” which nevertheless contains 
the essence of a valid proof. We write 

g° f(x) -g°f(a) = g{f{x)) -g(f(a)) _ fjx) - /(a) 

fix) - /(a) 


x — a 


x — a 


(1) 
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for x 7 ^ a. Since lim x _>. a f(x) = /(a), we have 

,• 9{f{x))-g{f[a)) = g{y)~g{f{a)) 


a'{f{a))- 


(2) 


We also have lim x _>. 0 = f'{ a )i so (1) shows (g o f)'(a ) = 

g'(f{a)) ■ f(a). 

The main problem with this “proof” is that f(x) — f(a) in Eq. (2) 
might be 0 for x arbitrarily close to a. If, however, f{x) ^ f{a ) for 
x near a, then this proof can be made rigorous. If f(x) = f{a ) for 
some x’s near a, the “proof” cannot be repaired using (2). In fact, 
Exercise 28.5 gives an example of differentiable functions / and g for 
which lim x _>.o is meaningless. 

We now give a rigorous proof, but we will use the sequential 
definition of a limit. The proof reflects ideas in the article by Stephen 
Kenton [36]. 


Proof 

The hypotheses include the assumptions that / is defined on an 
open interval J containing a, and g is defined on an open interval 
I containing /(a). It is easy to check g o f is defined on some open 
interval containing a (see Exercise 28.13), so by taking J smaller if 
necessary, we may assume g o / is defined on J. 

By Definitions 20.3(a) and 20.1, it suffices to consider a sequence 
(x n ) in J \ {a} where lirn„ x n = a and show 

,. 9 ° f(x n ) ~ go f(a) , , 

Inn -= g (/(a)) • / (a). (3) 

n—HK) x n — a 

For each n, let y n = f(x n ). Since / is continuous at x = a, we have 
hm n y n = f(a). For f(x n ) ^ f(a), 

{go f){x n ) ~ {go f){g) = g{y n ) - g(/(«)) _ f{x n ) ~ f{g ) 

x n - a y n - f{a ) x n - a 

Case 1. Suppose f(x) ^ f(a ) for x near a. Then y n = f(x n ) ^ 

f(a) for large n, so taking the limit in (4), as n —> oo, we obtain 

{g° f)'{a) = g'{f{a )) • f'{a). 
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Case 2. Suppose f(x) = f(a ) for x arbitrarily close to a. Then 
there is a sequence (z n ) in J\ {a} such that lim n z n = a and f(z n ) = 
/(a) for all n. Then 


/'(a) = lim /fa) ~ /(a) = lim -°- 
n-> oo Z n — a n-y oo z n — a 

and it suffices to show (g o /)'(a) = 0. We do have 


= 0 , 


lim 9(/( ""> ) ~ g(/( °» = lim = 0 , 

n—Hx> Z n — a n—Hx z n — a 

but this only assures us that (g o f)'(a ) = 0 provided we know this 

derivative exists. To help us prove this, we note g'(f(a)) exists and 

so the difference quotients are bounded near f(a). Thus, 

replacing the open interval I by a smaller one if necessary, there is 

a constant C > 0 so that 


g(y)-g{f{a)) 


y - f(a ) 


<C for y£/\/(a). 


Therefore 


(g°f)(x n ) - (g° f){a) 

< r 

3 

1 

% n ^ 


X n Cl 


for large n, (5) 


which is clear if f(x n ) = f{a ) and otherwise follows from Eq. (4). 
Since f'{a) = 0, the right side of (5) tends to 0 as n -> oo; thus 
the left side also tends to 0. Since (x n ) is any sequence in J \ {a} 
converging to a, we conclude (g o f)'{a) = 0 , as desired. ■ 


It is worth emphasizing that if / is differentiable on an interval I 
and if g is differentiable on {f(x) : x 6 I}, then (g o /)' is exactly 
the function ( g' o f) • f on I. 


Example 5 

Let h(x) = sin(x 3 + 7x) for x £ K. The reader can undoubtedly 
verify h'(x) = (3x 2 + 7) cos(x 3 + 7x) for x £ M using some automatic 
technique learned in calculus. Whatever the automatic technique, it 
is justified by the chain rule. In this case, h = g o f where f(x) = 
x 3 + 7x and g(y) = siny. Then f'(x) = 3x 2 + 7 and g'{y) = cos y so 
that 

h'{x) = g'(f(x)) ■ f'(x) = [cos f(x)] ■ f'(x) = [cos(x 3 + 7x)] ■ (3x 2 + 7). 
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We do not want the reader to unlearn the automatic technique, but 
the reader should be aware that the chain rule stands behind it. □ 


Exercises 

28.1 For each of the following functions defined on R, give the set of 
points at which it is not differentiable. Sketches will be helpful. 

(a) el x ! (b) sin |x| 

(c) | sinx| (d) |x| + \x — 1| 

(e) |ie 2 -1| (f) |ie 3 — 8 | 

28.2 Use the definition of derivative to calculate the derivatives of the 
following functions at the indicated points. 

(a) /(; x) = x 3 at x = 2; 

(b) g{x) = x + 2 at x = a; 

(c) f(x) = x 2 cosx at x = 0; 

(d) r(x) = at x = 1. 

28.3 (a) Let h(x) = yfx = x 1 ^ 2 for x > 0. Use the definition of derivative 

to prove h'(x) = \x^ x ! 2 for x > 0. 

(b) Let f{x) = a: 1 / 3 for x £ R and use the definition of derivative 
to prove f'(x) = \x~ 2 ^ for i/0. 

(c) Is the function / in part (b) differentiable at x = 0? Explain. 

28.4 Let f[x) = x 2 sin ^ for x 0 and /(0) = 0. 

(a) Use Theorems 28.3 and 28.4 to show / is differentiable at each 
a / 0 and calculate f(a). Use, without proof, the fact that 
sin a; is differentiable and that cosie is its derivative. 

(b) Use the definition to show f is differentiable at x = 0 and 

f(0) = o. 

(c) Show /' is not continuous at x = 0. 

28.5 Let f{x) = x 2 sin ^ for x ^ 0, /(0) = 0, and gix) = x for x € R. 

(a) Observe / and g are differentiable on R. 

(b) Calculate fix) for x = W, n = ±1, ±2,.... 

(c) Explain why lim^^o g< ~~^y(2)—/(o) 0 ^ mean ingless. 
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28.6 Let f(x) = xsin ~ for x 7^ 0 and /(0) = 0. See Fig. 19.3. 

(a) Observe / is continuous at x = 0 by Exercise 17.9(c). 

(b) Is / differentiable at x = 0? Justify your answer. 

28.7 Let f(x) = x 2 for x > 0 and f(x) = 0 for x < 0. 

(a) Sketch the graph of /. 

(b) Show / is differentiable at x = 0. Hint : You will have to use 
the definition of derivative. 

(c) Calculate /' on R and sketch its graph. 

(d) Is /' continuous on R? differentiable on R? 

28.8 Let f(x) = x 2 for x rational and f(x) = 0 for x irrational. 

(a) Prove / is continuous at x = 0. 

(b) Prove / is discontinuous at all i/0. 

(c) Prove / is differentiable at x = 0. Warning : You cannot simply 
claim f'(x) = 2x. 

28.9 Let h(x) = ( x 4 + 13a;)'. 

(a) Calculate h'(x). 

(b) Show how the chain rule justifies your computation in part (a) 
by writing h = g o f for suitable / and g. 

28.10 Repeat Exercise 28.9 for the function h(x) = (cos a; + e x ) 12 . 

28.11 Suppose / is differentiable at a, g is differentiable at /(a), and h is 
differentiable at g o /(a). State and prove the chain rule for (ho g o 
f)'(a). Hint: Apply Theorem 28.4 twice. 

28.12 (a) Differentiate the function whose value at x is cos(e 3;B ~ 3a: ). 

(b) Use Exercise 28.11 or Theorem 28.4 to justify your computation 
in part (a). 

28.13 Show that if / is defined on an open interval containing a, if g is 
defined on an open interval containing f(a), and if / is continuous 
at a , then g o f is defined on an open interval containing a. 

28.14 Suppose / is differentiable at a. Prove 

(a) lim„ 0 /(a+ ^ /(a) = /», (b) lim^o ^ a+h ^ a ~ h ^ = f'(a). 
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28.15 Prove Leibniz’ rule 

k=0 ' ' 

provided both / and g have n derivatives at a. Here foh') signifies 
the jth derivative of h so that h = h, = h !, h ^ = h", etc. 
Also, (^) is the binomial coefficient that appears in the binomial 
expansion; see Exercise 1.12. Hint: Use mathematical induction. For 
n = 1, apply Theorem 28.3(iii). 

28.16 Let / be a function defined on an open interval I containing a. Show 
f'(a) exists if and only if there is a function e(x) defined on / such 
that 


/( x) — f(a ) = (x — a)[f'(a) — e(x)] and lim e(x) = 0. 

x —Ya 


§29 The Mean Value Theorem 

Our first result justifies the following strategy in calculus: To find the 
maximum and minimum of a continuous function / on an interval 
[a, b] it suffices to consider (a) the points x where f'(x) = 0; (b) the 
points where / is not differentiable; and (c) the endpoints a and b. 
These are the candidates for maxima and minima. 


29.1 Theorem. 

If f is defined on an open interval containing xq, if f assumes its 
maximum or minimum at xq, and if f is differentiable at xq, then 
f(x o) = 0. 


Proof 

We suppose / is defined on (a, b) where a < xq < b. Since either / 
or — / assumes its maximum at xq, we may assume / assumes its 
maximum at xq. 

Assume first that f'{x o) > 0. Since 


/' Oo) 


lim 

X^-XQ 


f(x) - f(x 0 ) 


X — Xq 
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there exists <5 > 0 such that a < xq — 5 < xq + 5 < b and 

0 < \x — xo| < 5 implies ^ ^^ > 0 ; ( 1 ) 

x — Xq 

see Corollary 20.7. If we select x so that xq < x < xq + <5, then (1) 
shows f(x) > f(x o), contrary to the assumption that / assumes its 
maximum at xo. Likewise, if f'(x o) < 0, there exists <5 > 0 such that 

0 < \x — xq\ < 5 implies - f( x °^ < o. (2) 

x — Xq 

If we select x so that xq — 5 < x < xq, then (2) implies f(x) > /(xq), 
again a contradiction. Thus we have /'( xq ) = 0. ■ 

Our next result is fairly obvious except for one subtle point: one 
needs to know or believe that a continuous function on a closed 
interval assumes its maximum and minimum. We proved this in 
Theorem 18.1 using the Bolzano-Weierstrass theorem. 

29.2 Rolle’s Theorem. 

Let f be a continuous function on [a, b] that is differentiable on (a, b) 
and satisfies f(a) = f(b). There exists [at least one\ x in ( a, 6) such 
that f'(x) = 0. 

Proof 

By Theorem 18.1, there exist xq, x/q £ [a, 6 ] such that f(x 0 ) < f(x) < 
f{yQ) for all x £ [a, b\. If xq and yo are both endpoints of [a, b], then 
/ is a constant function [since /(a) = /(&)] and f'(x) = 0 for all 
x £ ( a,b ). Otherwise, / assumes either a maximum or a minimum 
at a point x in (a, 6), in which case f'(x) = 0 by Theorem 29.1. ■ 

The Mean Value Theorem tells us that a differentiable function 
on [a, b] must somewhere have its derivative equal to the slope of the 
line connecting (a, /(a)) to (b,f(b)), namely ■ See Fig. 29.1. 

29.3 Mean Value Theorem. 

Let f be a continuous function on [a, b ] that is differentiable on (a, b ). 
Then there exists [at least one] x in (a, b) such that 
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{bjm 


b 


FIGURE 29.1 


/'(*) 


f{b) - f(a ) 
b — a 


(1) 


Note that Rolle’s Theorem is the special case of the Mean Value 
Theorem where /(a) = /(&). 


Proof 

Let L be the function whose graph is the straight line connect¬ 
ing (a,/(a)) to (b,f(b)), i.e., the dotted line in Fig. 29.1. Observe 
L(a ) = /(a), L(b) = f(b) and L'(x ) = for all x. Let 

g(x) = f(x) — L{x) for x E [a,b\. Clearly g is continuous on [a,b\ 
and differentiable on (a, b). Also g(a) = 0 = g(b), so g\x) = 0 
for some x E (a, b) by Rolle’s Theorem 29.2. For this x, we have 
/'(*) = L'(x) = Mg®. m 


29.4 Corollary. 

Let f be a differentiable function on (a, b) such that f'[x ) = 0 for all 
x E (a, b). Then f is a constant function on ( a,b ). 


Proof 

If / is not constant on (a, b), then there exist x\,X 2 such that 


a < x\ < X 2 < b and f(x i) 7 ^ f(x 2 ). 

By the Mean Value Theorem, for some x E (xi,X 2 ) we have f'{x ) = 

a con ^ rat [j c ^ ori ■ 


a:2— 
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29.5 Corollary. 

Let f and g be differentiable functions on (a, b) such that f = g' on 
( a,b ). Then there exists a constant c such that f{x) = g{x) + c for 
all x 6 (a, b). 

Proof 

Apply Corollary 29.4 to the function f — g. ■ 

Corollary 29.5 is important for integral calculus because it guar¬ 
antees all antiderivatives, alias indefinite integrals, for a function 
differ by a constant. Old integral tables and modern computational 
software programs provide formulas like 

J x 2 cos xdx = 2x cos x + (x 2 — 2 ) sin x + C. 

It is straightforward to show the derivative of each function 2x cos x+ 
(x 2 — 2 ) sin x + C is in fact x 2 cosx. Corollary 29.5 shows that these 
are the only antiderivatives of x 2 cos x. 

We need some terminology in order to give another useful 
corollary of the Mean Value Theorem. 

29.6 Definition. 

Let / be a real-valued function defined on an interval /. We say / is 
strictly increasing on I if 


X\,X2 G I 

and 

X\ < X2 

imply 

f(x l) < f{x 2 ) 

strictly decreasing 

on I if 




Xi,X 2 € I 

and 

X\ < X2 

imply 

f{x 1 ) > f(x 2 ) 

increasing on I if 





Xi,X2 G I 

and 

X\ < X2 

imply 

f{x 1 ) < f(x 2 ) 

and decreasing on 

/ if 




xi,x 2 G I 

and 

X\ < X 2 

imply 

f(x 1 ) > f(x 2 ) 


Example 1 

The functions e x on M and yfx on [0, oo) are strictly increasing. The 
function cosx is strictly decreasing on [ 0 , 7 r]. The signurn function 
and the postage-stamp function in Exercises 17.10 and 17.16 are 
increasing functions but not strictly increasing functions. □ 
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29.7 Corollary. 

Let f be a differentiable function on an interval ( a,b ). Then 

(i) f is strictly increasing if f'(x) > 0 for all x E (a, 6); 

(ii) / is strictly decreasing if f'(x) < 0 for all x E (a, 6); 

(iii) / is increasing if f'(x) > 0 for all x E (a, 6); 

(iv) / is decreasing if f'{x) < 0 for all x E (a, b). 


Proof 

(i) Consider xi, X 2 where a < x\ < x 2 < b. By the Mean Value 
Theorem, for some x E (xi,X 2 ) we have 


f(x 2 ) - f[x i) 
£ 2 — *1 


f'{x) > 0. 


Since X 2 — xi > 0, we see f(x 2 ) — /(xi) > 0 or /(x 2 ) > /(xi). 
The remaining cases are left to Exercise 29.8. ■ 


Exercise 28.4 shows the derivative f of a differentiable function 
/ need not be continuous. Nevertheless, like a continuous function, 
f has the intermediate value property [see Theorem 18.2]. 


29.8 Intermediate Value Theorem for Derivatives. 

Let f be a differentiable function on (a,b). If a < x\ < x 2 < b, and 
if c lies between f'(x 1 ) and f'(x 2 ), there exists [at least one] x in 
(x\,x 2 ) such that f'{x ) = c. 


Proof 

We may assume f'(x 1 ) < c < f'(x 2 ). Let g(x) = f(x) — cx for 
x E (a, 6). Then we have g'(x 1 ) < 0 < g'{x 2 ). Theorem 18.1 shows g 
assumes its minimum on [x\,x 2 ] at some point xq E [x\,x 2 ]. Since 


g\x 1 ) 


lim 

y-*x 1 


g{v) - 1 ) 

y-x 1 


<0, 


g{y)—g{xi) is negative for y close to and larger than x\. In particular, 
there exists y 1 in {x\,x 2 ) such that g{yf) < g(x 1 ). Therefore g does 
not take its minimum at x \, so we have xo f 1 x\. Similarly, there 
exists y 2 in (x 1 , 3 : 2 ) such that g{y 2 ) < g(x 2 ), so xq x 2 . We have 
shown xo is in (xi,x 2 ), so g'(x 0 ) = 0 by Theorem 29.1. Therefore 
f'(x 0 ) = g'(x 0 ) + c = c. U 
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We next show how to differentiate the inverse of a differentiable 
function. Let / be a one-to-one differentiable function on an open 
interval I. By Theorem 18.6, / is strictly increasing or strictly de¬ 
creasing on I, and by Corollary 18.3 the image f(I) is an interval J. 
The set J is the domain of / _1 and 

f~ lo f(x)=x for x € I-, f°f~ 1 (y) = y for y € J. 

The formula for the derivative of / _1 is easy to obtain [or remember] 
from the Chain Rule: x = / _1 o f(x), so 

1 = (/ _1 )'(/<») • f'(x) for all x€l. 


If a;o 6 / and yo = f(x o), then we can write 1 = (/ 1 ) , (yo) ■ f{x o) or 


(/ _1 )'(y o) 


l 

f'(x o) 


where y 0 = f(x 0 ). 


This is not a proof because the Chain Rule requires the functions, f~ 3 
and / in this case, be differentiable. We assumed / is differentiable, 
but we must prove / _1 is also differentiable. In addition, observe 
f(x o) might be 0 [consider f(x) = x 3 at xq = 0 ], so our final result 
will have to avoid this possibility. 


29.9 Theorem. 

Let f be a one-to-one continuous function on an open interval I, and 
let J = /(/). If f is differentiable at xo G I and if f(x o) 7 ^ 0, then 
/ -1 is differentiable at yo = f{x 0 ) and 


(/ _1 y(y0) 


1 

/'(* 0)’ 


Proof 

Note that J is also an open interval. We have lim a ,^. a;o = 

f(x 0 ). Since f(x 0 ) 7 ^ 0 and since f(x) 7 ^ f(x 0 ) for x near xo, we 
can write 


x - Sq _ 1 

/(x) - /(s 0 ) /'(*o)’ 


( 1 ) 


see Theorem 20.4(iii). Let e > 0. By (1) and Corollary 20.7, there 
exists 6 > 0 such that 


x — So 1 

f(x) ~ /(To) f(x 0 ) 


0 < \x — sq| < 5 implies 


< e. (2) 
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Let g = f~ 1 and observe that g is continuous at yo by Theorems 18.6 
and 18.4 [or Exercise 18.11]. Hence there exists rj > 0 [lower case 
Greek eta] such that 


o < \y ~ yo\ < v implies I g(y) - y(y 0 )| < S, i.e., | g(y) - x 0 | < 5. 

( 3 ) 

Combining (3) and (2) we obtain 

g(y) ~ x 0 


0 < \y — 2/oI < V implies 
g(y)-xo 

f{g{y))-f\x 0 ) 


1 


Sirip. g(y )~ x o _ g(y)-gfao) tll ;„ „i inws 
since — y _ yo , tnis snows 


lim 


f{g{y)) - f{x o) f'{x 0 ) 

iis si 

g(y) -g{yo) 


< e. 


y^yo y-yo fix o)' 

Hence g'(yo) exists and equals jrn^s ■ 


Example 2 

Let n be a positive integer, and let g(y) = y = y 1 ^ n . If n is even, the 
domain of g is [0, oo) and, if n is odd, the domain is M. In either case, 
g is strictly increasing and its inverse is f(x) = x n ; here dom(/) = 
[0, oo) if n is even. Consider yo hr dom(y) where yo 7 ^ 0, and write 
yo = Xq where xo € dom(/). Since f'(x 0 ) = nxg -1 , Theorem 29.9 
shows 


g'(yo) = 


nx, 


n —1 


nyo 


1 _ ]L l/n-l 

(n-l)/n ~ n y ° 


This shows the function g is differentiable for y 7 ^ 0 and the rule 
for differentiating x n holds for exponents of the form 1 /n; see also 
Exercise 29.15. □ 


Theorem 29.9 applies to the various inverse functions encountered 
in calculus. We give one example. 

Example 3 

The function f(x) = sinx is one-to-one on [—§,§], and it is tradi¬ 
tional to use the inverse g of / restricted to this domain; g is usually 
denoted Sin -1 or arcsin. Note that dom(y) = [—1,1], For yo = sinxo 
in (-1,1) where x 0 € (-f, f), Theorem 29.9 shows y'(yo) = 
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Since 1 = sin 2 xo + cos 2 xo = Vo + cos 2 xq and cosxo > 0, we may 
write 



□ 


Exercises 

29.1 Determine whether the conclusion of the Mean Value Theorem holds 
for the following functions on the specified intervals. If the conclusion 
holds, give an example of a point x satisfying (1) of Theorem 29.3. 
If the conclusion fails, state which hypotheses of the Mean Value 
Theorem fail. 

(a) x 2 on [—1,2], (b) sinx on [0 , tt], 


(d) A on [-1,1], 

(f) sgn(x) on [-2,2], 


(c) |x| on [-1,2], 

( e ) y on I 1 ! 3 ]. 


The function sgn is defined in Exercise 17.10. 

29.2 Prove | cosx — cosy| < \x — y\ for all x,y £ R. 

29.3 Suppose / is differentiable on R and /(0) = 0, /(1) = 1 and /(2) = 


1 . 


(a) Show f'{x) = A for some x £ (0, 2). 

(b) Show f'{x) = \ for some x £ (0, 2). 

29.4 Let / and g be differentiable functions on an open interval I. 
Suppose a, b in I satisfy a < b and /(a) = f(b) = 0. Show 
f'(x ) + f{x)g'{x ) = 0 for some x £ ( a,b ). Hint : Consider h(x) = 
f{x)e^ x \ 

29.5 Let / be defined on R, and suppose | f(x) — f(y) \ < (x — y) 2 for all 
x, y £ R. Prove / is a constant function. 

29.6 Give the equation of the straight line used in the proof of the Mean 
Value Theorem 29.3. 

29.7 (a) Suppose / is twice differentiable on an open interval I and 

f"(x) = 0 for all x £ I. Show / has the form f(x) = ax + b for 
suitable constants a and b. 

(b) Suppose / is three times differentiable on an open interval I 
and /"' = 0 on I. What form does / have? Prove your claim. 





240 **• Differentiation 

29.8 Prove (ii)-(iv) of Corollary 29.7. 

29.9 Show ex < e x for all ieR. 

29.10 Let f(x) = x 2 sin(i) + | for x 0 and /(0) = 0. 

(a) Show /'(0) > 0; see Exercise 28.4. 

(b) Show / is not increasing on any open interval containing 0. 

(c) Compare this example with Corollary 29.7(i). 

29.11 Show sin a: < x for all x > 0. Hint: Show f[x) = x— sin a; is increasing 
on [0,oo). 

29.12 (a) Show x < tana; for all x £ (0, |). 

(b) Show is a strictly increasing function on (0, |). 

(c) Show x < | sin x for x £ [0, |]. 

29.13 Prove that if / and g are differentiable on R, if /(0) = g{ 0) and if 
f'(x) < g'(x) for all x £ R, then f(x) < g(x) for x > 0. 

29.14 Suppose / is differentiable on R, 1 < f'(x) < 2 for x £ R, and 
/(0) = 0. Prove x < /( x) < 2x for all x > 0. 

29.15 Let r be a nonzero rational number — where n is a positive integer, 
to is any nonzero integer, and m and n have no common factors. 
Let h(x) = x r where dom(h) = [0, 00) if n is even and to > 0, 
dom(/i) = ( 0 , 00) if n is even and to < 0 , dom(h) = R if n is odd 
and to > 0, and dom(/i) = R \ {0} if n is odd and to < 0. Show 
h'(x) = rx r ~ 1 for x £ dom(h), x 7 ^ 0. Hint : Use Example 2. 

29.16 Use Theorem 29.9 to obtain the derivative of the inverse g = 
Tan -1 = arctan of / where f(x) = tana; for x £ (— f , §). 

29.17 Let / and g be differentiable on an open interval / and consider 
a £ I. Define h on I by the rules: h(x) = /( x) for x < a, and 
h(x) = g{x) for x > a. Prove h is differentiable at a if and only if 
both /(a) = g(a) and f(a) = g'(a ) hold. Suggestion: Draw a picture 
to see what is going on. 

29.18 Let / be differentiable on R with a = sup{|/ / (a;)| : x £ R} < 1. 

(a) Select sq £ R and define s n = f(s n - 1 ) for n > 1. Thus si = 
/(so), s 2 = f(s 1 ), etc. Prove (s„) is a convergent sequence. 
Hint: To show that (s n ) is Cauchy, first show |s n+ i — s n | < 
a\s n — s ra _i| for n > 1 . 

(b) Show / has a fixed point, i.e., f(s) = s for some s in R. 
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30 * L’Hospital’s Rule 


In analysis one frequently encounters limits of the form 


lim 

x—fs 


f 0*0 

g 0) 


where s signifies a, a + , a~, oo or —oo. See Definition 20.3 concerning 
such limits. The limit exists and is simply g{x) provided the 

limits lim^^s f(x ) and lim^s g(x) exist and are hnite and provided 
lim x _>. s g(x) ^ 0; see Theorem 20.4. If these limits lead to an inde¬ 
terminate form such as jj or then L’Hospital’s rule can often be 
used. Moreover, other indeterminate forms, such as oo — oo, 1°°, oo°, 
0° or 0 • oo, can usually be reformulated so as to take the form ~ or 
see Examples 5-9. Before we state and prove L’Hospital’s rule, 
we will prove a generalized mean value theorem. 


30.1 Generalized Mean Value Theorem. 

Let f and g be continuous functions on [a, b] that are differentiable 
on ( a,b ). Then there exists [at least one] x in (a,b) such that 

f\x)[g{b) - g(a)} = g\x)[f{b) - /(a)]. (1) 

This result reduces to the standard Mean Value Theorem 29.3 
when g is the function given by g(x) = x for all x. 


Proof 

The trick is to look at the difference of the two quantities in (1) and 
hope Rolle’s Theorem will help. Thus we define 

h(x ) = f{x)[g(b) - g(a )] - g{x)[f(b) - /(a)]; 

it suffices to show h'(x) = 0 for some x € (a, b). Note 

h{a) = f{a)[g(b) - g(a)\ - g(a)[f(b) - /(a)] = f(a)g(b) - g(a)f(b) 

and 

h(b) = f{b)\g{b) - g(a)] - g(b)[f{b) - /(a)] = -f{b)g{a) + g{b)f(a ) = h(a). 

Clearly h is continuous on [a, b\ and differentiable on (a, 6), so Rolle’s 
Theorem 29.2 shows h'{x) = 0 for at least one x in (a, b). ■ 
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Our proof of L’Hospital’s rule below is somewhat wordy but is 
really quite straightforward. It is based on the elegant presentation 
in Rudin [62], Many texts give more complicated proofs. 


30.2 L’Hospital’s Rule. 

Let s signify a, a + , a~, oo or —oo where a£l, and suppose f and 
g are differentiable functions for which the following limit exists: 


lim 

rr—7-s 


g' 0 ) 


= L. 


(1) 


If 


or if 


lim f(x) = lim g(x) = 0 

x—x— 


lim I I = +oo, 

x —ys 


then 


(2) 

( 3 ) 


lim 

x —ys 


f(x) 

9(x) 


= L. 


( 4 ) 


Note that the hypothesis (1) includes some implicit assumptions: 
/ and g must be defined and differentiable “near” s and g'(x) must be 

f'(x) 

nonzero “near” s. For example, if lim^_. a + J ,) { exists, then there is 

9 \ x ) 

an interval (a, b ) on which / and g are differentiable and g' is nonzero. 
The requirement that g' be nonzero is crucial; see Exercise 30.7. 


Proof 

We first make some reductions. The case of lim x ^. a follows from the 
cases lim x _>. a + and lim x _>. a -, since lim X ^ a h(x) exists if and only if 
the limits lim x ^ a + h(x ) and lim x ^. a - h(x) exist and are equal; see 
Theorem 20.10. In fact, we restrict our attention to lim x _ m + and 
lim-E^-oo, since the other two cases are treated in an entirely analo¬ 
gous manner. Finally, we are able to handle these cases together in 
view of Remark 20.11. 
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We assume a£8ora = —oo. We will show that if —oo < L < oo 
and L\ > L, then there exists a\ > a such that 


a < x < ot\ implies 


fix) 

9{x) 


<L X . 


( 5 ) 


A similar argument [which we omit] shows that if —oo < L < oo and 
L 2 < L, then there exists cti > a such that 


a < x < «2 implies 


fix) 

9ix) 


> L2. 


( 6 ) 


We now show how to complete the proof using (5) and (6); (5) will 
be proved in the next paragraph. If L is finite and e > 0, we can 
apply (5) to L\ = L + e and (6) to L 2 = L — e to obtain a\ > a and 
a. 2 > a satisfying 


a < x < a\ implies 
a < x < «2 implies 


/ O) 
9 O) 
/ 0 ) 
9(x) 


< L + e, 
> L — e. 


Consequently if a = min{a;i,a 2 } then 


a < x < a implies 


fix) _ 

g{x) 


< e; 


in view of Remark 20.11 this shows linx r _ ) . a + = L [if a = — 00 , 
then a + = — 00 ]. If L — — 00 , then (5) and the fact that L\ is 
arbitrary show liin x _^ a + = — 00 . If L = 00 , then (6) and the fact 

that L 2 is arbitrary show lim x _ 5 . a + = 00 . 

It remains for us to consider L\ > L > — 00 and show there 
exists chi > a satisfying (5). Let (a, b) be an interval on which / and 
g are differentiable and on which g' never vanishes. Theorem 29.8 
shows either g' is positive on (a, b) or else g' is negative on (a, b). 
The former case can be reduced to the latter case by replacing g 
by —g. So we assume g'{x) < 0 for x €E (a, b), so that g is strictly 
decreasing on (a, b) by Corollary 29.7. Since g is one-to-one on (a, b), 
g(x) can equal 0 for at most one x in (a, b ). By choosing b smaller if 
necessary, we may assume g never vanishes on (a, b). Now select K 
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so that L < K < L\. By (1) there exists a > a such that 

f^(x\ 

a < x < a implies < K. 

gix) 

If a < x < y < a, then Theorem 30.1 shows 
fix) - f(y) f\z ) 


g{x) - g(y) g'{z) 


for some z E (x, y). 


Therefore 

a < x < y < a implies 
If hypothesis (2) holds, then 


fix) - fjy) 

g(x) - g{y) 


so (7) shows 


lim 

x— >-a+ 


fix) - f(y) 

g{x) - g(y) 


fiv) 

g{y )’ 


( 7 ) 


— 7—7 < K < L\ for a < y < a; 

9iv) 

hence (5) holds in this case. If hypothesis (3) holds, then lim x _ > . a + 
g(x) = +00 since g is strictly decreasing on (a, b). Also g{x) > 0 for 
x E (a, b) since g never vanishes on (a, b). We multiply both sides 
of (7) by 9( ' X g ^ y ' > , which is positive, to see 

„ „ „ . f{x)-f{y) ^ T s g(x)-giy) 

a < x < y < a implies -—- < A •-—- 

g{x) g[x) 

and hence 

fix) K gjx)-gjy) fjy) _ fjy)-Kgjy) 

gix) ^ ' g(x) + g{x) + gix) ■ 

We regard y as fixed and observe 

fiy) — Kgiy) 
lim J = 0 . 

2 —»a+ g(x) 

Hence there exists a .2 > a such that «2 < y < a and 


a < x < «2 implies 


fix) 

gix) 


< K < Li. 


Thus again (5) holds. 
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Example 1 

If we assume familiar properties of the trigonometric functions, then 
lim x _>.o is easy to calculate by L’Hospital’s rule: 


sm x cos x 

Inn-= lim-= cos 

i->0 X £->0 1 

Note /(x) = sinx and g(x) = x satisfy the hypotheses in Theo¬ 
rem 30.2. This particular computation is really dishonest, because 
the limit (1) is needed to prove the derivative of sinx is cosx. This 
fact reduces to the assertion that the derivative of sinx at 0 is 1, i.e., 
to the assertion 

sin x — sin 0 sin x 

lim- = lim- = 1. 

£->o x — 0 x->0 x □ 


( 0 ) = 1. ( 1 ) 


Example 2 

We calculate lim^o cos ^ 2 ~ 1 ■ L’Hospital’s rule will apply provided the 
limit lirn x ^o ~2 ™ x exists, but = — \^r an< ^ fhi s ^ as — \ 

by Example 1. We conclude 

cos x — 1 1 

Inn- t, -= —. 

x-to x 2 2 □ 

Example 3 

2 

We show liiri-j^oo = 0. As written we have an indeterminate 
of the form —. By L’Hospital’s rule, this limit will exist provided 
lirrix^oo exists and by L’Hospital’s rule again, this limit will 
exist provided lim x _ >00 exists. The last limit is 0, so we conclude 

hm-x^oo = 0. □ 

Example 4 

Consider lim x _> 0 + ~~p~ if if exists. By L’Hospital’s rule, this appears 
to be 

i- f/ x 

hm -= Too 

£—>0+ 1 

and yet this is incorrect. The difficulty is that we should have checked 
the hypotheses. Since lim x ^ 0 + log e x = — oo and lim x _> 0 + x = 0, 
neither of the hypotheses (2) or (3) in Theorem 30.2 hold. To 
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find the limit, we rewrite Ioge x as — Iug,: 1 . It is easy to show 

lim x _> 0 + lug '-’ ] will agree with lim^oo y log e y provided the lat¬ 
ter limit exists; see Exercise 30.4. It follows that lim a; _ > o+ —fr— = 
- lirrp^oo y log e y = -oo. □ 

The next five examples illustrate how indeterminate limits of 
various forms can be modified so that L’Hospital’s rule applies. 


Example 5 

Consider lim x _j.o+ x\og e x. As written this limit is of the indetermi¬ 
nate form 0 • (—oo) since lim a ._ >0 + x = 0 and linx E _ > o+ log e x = ^oo. 
By writing x log e x as ~[j^r we obtain an indeterminate of the form 
so we may apply L’Hospital’s rule: 

lim x log e x = lim —^— = lim x , = — lim x = 0. 

i->-0+ x— >-0+ - :r—>0+ —9 x— >o+ 

X X z 

We could also write x log e x as 1/iog e s to obtain an indeterminate 
of the form jj. However, an attempt to apply L’Hospital’s rule only 
makes the problem more complicated: 


lim x log„ x 

x^0+ 


lim 

£—> 0 + 


X 

1 

l°g e x 


lim 

x— »o+ 


1 

-l 

z(log e x )‘ 2 


= — lim .T(log e x) 2 . 

x— >-0+ 


□ 


Example 6 

The limit linx r _ > o+ x x is of the indeterminate form 0°. We write x x as 
e x loge x [remember x = e loge x ] and note that lim a ._ >0 + x log e x = 0 by 
Example 5. Since g{x) = e x is continuous at 0, Theorem 20.5 shows 

lim x x = lim e x loge x = e° = 1. 

x— >0+ x— >0+ □ 


Example 7 

The limit liim^oo x l ^ x is of the indeterminate form oo°. We write 
x x ! x as e( loge x )/ a . By L’Hospital’s rule 


lim 

x —^OO 


logg x 
x 


i 


= lim f = 0. 

£—>•00 1 


x —>-oo 


Theorem 20.5 now shows lim. 


X i/x _ e o _ p 


□ 
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Example 8 

The limit lim a; ^. 00 (l — -) x is indeterminate of the form 1°°. Since 


_ 1 | = gXlog^l-l/x) 


we evaluate 


lim xlog e (1-^ = lim —— li m 




x 


X j x^too 


x—>oo — x 


-2 


x—>oo 

So by Theorem 20.5 we have 


= lim —II- = —1. 


lim (1-| = e 1 


x 


as should have been expected since lim n _ >0O (l ~ b) n = e 1 


□ 


Example 9 

Consider lim^^o h(x) where 

h(x) =-— = (e x — 1) _1 — x _1 for i^O. 

e x — 1 x 


Neither of the limits lim x _>.o( e:r — 1) _1 or lim x _ 5 .o a;_1 exists, so 
lim x _^o h(x) is not an indeterminate form as written. However, 
lim x _j. 0 + h(x) is indeterminate of the form oo — oo and lining- h{x) 
is indeterminate of the form (—oo) — (—oo). By writing 


h(x) 


x — e x T 1 
x(e x — 1) 


the limit lirn^^o h(x) becomes an indeterminate of the form jj. By 
L’Hospital’s rule this should be 


1 - e x 


lim , 

x->o xe x + e x — 1 


which is still indeterminate jj. Note xe x + e x — 1 ^ 0 for x ^ 0 
so that the hypotheses of Theorem 30.2 hold. Applying L’Hospital’s 
rule again, we obtain 


lim 


>o xe x + 2e x 


1 

2 ' 









248 Differentiation 


Note we have xe x + 2e x ^ 0 for x in (—2,oo). We conclude 
lim . x .+oh{x) =□ 


Exercises 

30.1 Find the following limits if they 
(a) lim M0 e2x ~ x cosx 
(c) lim^-^oo ^ 2 x 

30.2 Find the following limits if they 

(a) lim x _>.o s ; na ,_ x 
(c) lim x _^o(^--) 

30.3 Find the following limits if they 
(a) lim^ 

(c) lim x ^ 0+ 

30.4 Let / be a function defined on some interval (0, a), and define 
g{y) = /(-) for y £ (a _1 ,oo); here we set a -1 = 0 if a = oo. Show 
lim x _ >0 + f(x) exists if and only if lim^oo g{y) exists, in which case 
these limits are equal. 

30.5 Find the limits 

(a) lim x _K)(l + 2x) 1/x (b) lim y _ >00 (l + |) v 

(c) lim x ^. 00 (e a: + x) 1 ^ 

30.6 Let / be differentiable on some interval (c, cx>) and suppose 
lim x _ ) . 00 [/(a;) + f(x)] = L , where L is finite. Prove lim^oo f(x) = L 
and lirn^oo f(x) = 0. Hint : f(x) = /( ^] e • 

30.7 This example is taken from [65, p. 188] and is due to Otto Stolz [64]. 
The requirement in Theorem 30.2 that g'(x ) 7^ 0 for x “near” s is 
important. In a careless application of L’Hospital’s rule in which the 
zeros of g' “cancel” the zeros of /', erroneous results can be obtained. 
For x £ R, let 

f(x) = x + cosxsinx and g(x) = e slnx (x + cos a: sin x). 

(a) Show lim^oo f(x) = Hindoo g(x) = +00. 

(b) Show f'(x) = 2(cosa;) 2 and g'{x) = e sinx coszpcosa: + f(x)]. 


exist. 


(b) 

lim x _s. 0 

1—COS X 

X 2 

(d) 

lim x _s. 0 

\/l-\-X — \/\ — X 
X 

exist. 



(b) 

lima;—s-0 

tan x—x 

X 3 

(d) 

lim x _>o 

(cosa;) 1 /® 2 

exist. 



(b) 

lim x _ ) . 0 o z sm(1/x) 

(d) 

lim x ^ 0 

1—cos 2x—2x 2 

x A 
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(c) Show 


f'jx) _ 2e~ sin x cos x 
g'(x) 2 cos x-\-f(x) 


if cos x 0 and x > 3. 


(d) 


Show lim a; _ s . 00 
does not exist. 


2e~ sin x cos x 

2 cos x-\-f(x ) 


0 and yet the limit lim x _>. 00 


§31 Taylor’s Theorem 

31.1 Discussion. 

Consider a power series with radius of convergence R > 0 [R may 
be +oo]: 

OO 

f{x)=Y^a k x k . (1) 

k =0 

By Theorem 26.5, / is differentiable in the interval \x\ < R and 

OO 

f(x) = YkanJ- 1 . 

k=i 

The same theorem shows f is differentiable for |x| < R and 

OO 

f"( x ) = Y ^ ~ l ) a kX k ~ 2 - 

k =2 

Continuing in this way, we find the nth derivative /^ exists for 
|x| < R and 

OO 

Y\x) = Y k (k ~ 1) • • • (A; - n + 1 )a k x k ~ n . 

k=n 

In particular, 

/ (n) ( 0 ) = n(n — 1 ) • • • (n — n + l)a n = n\a n . 

This relation even holds for n = 0 if we make the convention /'°-* = / 
and recall the convention 0! = 1. Since /^(0) = k\a k , the original 
power series (1) has the form 

f(x ) = Y 1 k \ x ’ \x\<R. ( 2 ) 

k =0 
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As suggested at the end of §26, we now begin with a function / 
and seek a power series for /. The last paragraph shows / should pos¬ 
sess derivatives of all orders at 0, i.e., /'(0), /"(0), f'"{ 0 ),... should 
all exist. For such /, formula (2) might hold for some R > 0, in which 
case we have found a power series for /. □ 


One can consider Taylor series that are not centered at 0, just as 
we did with the power series in Example 7 on 190. 


31.2 Definition. 

Let / be a function defined on some open interval containing c. If / 
possesses derivatives of all orders at c, then the series 


OO 


E 


/ (fc) (c) 


k\ 


{x 


) 


( 1 ) 


is called the Taylor series for f about c. For n > 1, remainder R n (x) 
is defined by 


R n (x) 


n — 1 


/w-En^-o)* 


k=0 


(2) 


Of course the remainder R n depends on / and c, so a more ac¬ 
curate notation would be something like R n (f\c\x). The remainder 
is important because, for any x, 

°° 

f(x) = y ——— (x — c) k if and only if lim R n (x) = 0. 

J h\ n—>oo 

k =0 

We will show in Example 3 that / need not be given by its Taylor 
series, i.e., that lim^^oo R n {x) = 0 can fail. Since we want to know 
when / is given by its Taylor series, our various versions of Taylor’s 
Theorem all concern the nature of the remainder R n . 


31.3 Taylor’s Theorem. 

Let f be defined on (a, b ) where a < c < b; here we allow a = —oo 
or b = oo. Suppose the nth derivative f^ exists on (a, b ). Then for 
each x ^ c in (a, b ) there is some y between c and x such that 

fW (y) 

R n (x) = J —y{x- c ) n . 

n\ 
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The proof we give is due to James Wolfe 1 [71]; compare 
Exercise 31.6. 


Proof 

Fix a; t- c and n > 1. Let M be the unique solution of 

71—1 

f(x) = y ,,r y ( x - °f + 


/W(c). k M (x — c) r 


k =0 


k\ 


n\ 


(1) 


and observe we need only show 

f {n \y) = M for some y between c and x. (2) 

[To see this, replace M by f^ n \y) in Eq. (1) and recall the definition 
of R n (x).\ To prove (2), consider the difference 


71—1 


9(t) = Y 


k =0 


/ (fc) (c 

k\ 


-( t-c) k + 


M(t - c) r 


n\ 


- m. 


( 3 ) 


A direct calculation shows g(c) = 0 and g( k \c) = 0 for k < n. Also 
g{x) = 0 by the choice of M in (1). By Rolle’s theorem 29.2 we 
have g'{x\) = 0 for some x\ between c and x. Since g'{c) = 0, a 
second application of Rolle’s theorem shows g"(x 2) = 0 for some X 2 
between c and x\. Again, since g”(c) = 0 we have g"'(x 3) = 0 for 
some X3 between c and X 2 ■ This process continues until we obtain x n 
between c and x n -\ such that g^ n \x n ) = 0. From (3) it follows that 
g( n \t) = M — f( n \t) for all t 6 (a, 6), so (2) holds with y = x n . ■ 


31.4 Corollary. 

Let f be defined on (a, b ) where a < c < b. If all the derivatives f ^ 
exist on ( a,b ) and are bounded by a single constant C, then 

lim R n {x) = 0 for all x 6 (a, b). 

71 —fOO 

Proof 

Consider x in (a, 6). From Theorem 31.3 we see 

C 

\Rn(x)\ < — Ax — c\ n for all n. 
n\ 


1 My undergraduate real analysis teacher in 1954-1955. 








252 Differentiation 


\j. _ q\TI 

Since Hindoo , = 0 by Exercise 9.15, we conclude lim n _ > . 0O 

Rn(x) = 0 . ' ■ 

Example 1 

We assume the familiar differentiation properties of e x , sinx, etc. 
(a) Let /(x) = e x for x € M. Then f^ n \x) = e x for all n = 
0,1,2,..., so /(”)(0) = 1 for all n. The Taylor series for e x 
about 0 is 

oo 1 

Eb 1 *' 


k=0 


For any bounded interval (— M, M ) in M all the derivatives of 
/ are bounded [by e M , in fact], so Corollary 31.4 shows 

~ 1 


e x = y —x k for all x € 
k\ 


k=0 


(b) If f{x) = sin x for i£l, then 

y\ x ) = 


cosx 

— sin x 

— cosx 
sinx 


thus 


f H (0)={ -i 
0 


n = 1,5,9,... 
n = 2,6,10,... 
n = 3,7,ll,... 
n = 0,4,8,12,...; 


n = 1, 5, 9,... 
n = 3,7,ll,... 
otherwise. 


Hence the Taylor series for sin x about 0 is 


E 

k=0 


(2k + 1)! 


x 


2k+l 


The derivatives of / are all bounded by 1. so 


sm x = 


00 ( _1 \k 

— — —7T7X 2k+1 for all x € 


k=0 


(2fc + l)!‘ 


□ 
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Example 2 

In Example 2 of §26 we used Abel’s theorem to prove 

, „ _ 111111 

og e - _ 2 + 3 _ 4 + 5 _ 6 + 7 ‘ ^ 

Here is another proof, based on Taylor’s Theorem. Let f(x) = 
log e (l + x ) for x £ (—1, oo). Differentiating, we find 

f'(x) = {1 + x)- 1 , f"[x) = -{ l + x)~ 2 , f'"{x) = 2(1 + x) -3 , 


etc. A simple induction argument shows 

/(«)(x) = (-l)”+ 1 („-l)!(l+x)-" for n > 1 . ( 2 ) 

In particular, f^ n \ 0) = (—1 ) n+1 (n — 1)!, so the Taylor series for / 
about 0 is 


E 

k =1 


(- 1 ) 


k-\-l ™2 ™3 rp4: ™5 

lyt th th w tAy 

k x 


We also could have obtained this Taylor series using Example 1 in 
§26, but we need formula (2) anyway. We now apply Theorem 31.3 
with a = —1, b = Too, c = 0 and x = 1. Thus for each n there exists 
y n € (0,1) such that R n ( 1) = -—Equation (2) shows 


hence 


Rn( 1 ) 


(—l) n+1 (n — 1 )! 
(1 T y n ) n n\ 


Rn( 1 )| 


1 1 

(1 T y n ) n n < n 


for all n. 


Therefore linin^oo R n { 1) = 0, so the Taylor series for /, evaluated 
at x = 1 , converges to /( 1 ) = log e 2 , i.e., ( 1 ) holds. □ 


The next version of Taylor’s theorem gives the remainder in inte¬ 
gral form. The proof uses results from integration theory that should 
be familiar from calculus; they also appear in the next chapter. 

31.5 Taylor’s Theorem. 

Let f be defined on (a, b) where a < c < b, and suppose the nth 
derivative f ^ exists and is continuous on (a, b). Then for x € (a, b) 
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we have 

= r (x ( ~ ty 'v f {n) ^ dt - (!) 

Jc (n-1)! 

Proof 

For n— 1, Eq. (1) asserts 

#1 (x) = f(x) ~ f(c) = f f\t)dt ; 

J C 

this holds by Theorem 34.1. For n > 2, we repeatedly apply 
integration by parts, i.e., we use mathematical induction. So, as¬ 
sume (1) above holds for some n, n > 1. We evaluate the integral in 
(1) by Theorem 34.2, using u(t) = v'(t) = > so that 

u'(t ) = / ( - n+1 )(t) and u(t) = — . We obtain R n (x) 


/ X 

v(t)u' (t ) 


= &\x)-0 + &\c) 


(x-cr | r 


n\ 


dt 


(x - ty 


n\ 




The definition of in Definition 31.2 shows 


i*n +1 (®) = i*n(®) - - c)"j 


n! 


hence from (2) we see that (1) holds for n + 1. 


(2) 

( 3 ) 


31.6 Corollary. 

If f is as in Theorem 31.5, then for each x in (a, b ) different from c 
there is some y between c and x such that 

(nr — ni\ n ^ , . 

Jt.fr) = fr - C) ■ („_ !), / W (»)- (!) 

This form of is known as Cauchy’s form of the remainder. 


Proof 

We suppose x < c, the case x > c being similar. The Intermediate 
Value Theorem for Integrals 33.9 shows 


1 


c — x 



{x - t) n 1 (n) 
(n-1)! 7 


(t) dt 


(x — y) n 1 
(n-1)! 


) 


(2) 
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for some y in (x,c). Since the integral in (2) equals —R n (x) by 
Theorem 31.5, formula (1) holds. ■ 


Recall that, for a nonnegative integer n, the binomial theorem 
tells us 


(«+‘>*-£UK* 


k =0 


, kun—k 


where (”) = 1 and 


n 


n 


! n(n — 1) • • • (n — k + 1) 


K k J k\(n — k)\ 

Let a = x and 6=1; then 


k\ 


for 1 < k < n. 




k =1 


n(n — 1) • • • (n — k + 1) k 
k\ X ' 


This result holds for some values of x even if the exponent n is not 
an integer, provided we allow the series to be an infinite series. 

We next prove this using Corollary 31.6. Our proof is motivated 
by that in [55]. 


31.7 Binomial Series Theorem. 

If a 6 K and |x| < 1, then 


(l+z)« = l + £ 


k =1 


a(a — 1) • • • (a — k + 1) 
k\ ; 


(1) 


Proof 

For k = 1,2,3,..., let a k = —— /,+1) . If a is a nonnegative 
integer, then a k = 0 for k > a and (1) holds for all x as noted in 
our discussion prior to this theorem. Henceforth we assume a is not 
a nonnegative integer so that a k ^ 0 for all k. Since 


Ofc+l 


lim 

k—> oo 


a — k 
k + 1 


= 1 , 


lim 

k —^cxd 
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the series in (1) has radius of convergence 1; see Theorem 23.1 and 
Corollary 12.3. Lemma 26.3 shows the series 'ffkakX k ~ 1 also has 
radius of convergence 1, so it converges for \x\ < 1. Hence 

lim na n x n_1 = 0 for Ixl < 1 . ( 2 ) 

n—>• oo 


Let f{x ) = (1 + x) a for \x\ < 1. For n = 1, 2,..., we have 

f^ n \x) = a(a — 1 ) • • • (a — n + 1)(1 + x) a ~ n = n\a n ( 1 + x) a ~ n . 

Thus / (n) (0) = n\a n for all n > 1, and the series in (1) is the Taylor 
series for /. 

For the remainder of this proof, x is a fixed number satisfying 
|x| < 1. By Corollary 31.6, with c = 0, for each n , there is y n 
between 0 and x such that 

O / S s ( x — 2/n) n_1 . n . , Q -n 

R n (x) = x ■ — -- >{y n ) = x ■ — -—— n\a n 1 + y n 

(n — lj! (n — 1)1 

So 


\Rn(x)\ < |x| 


x-y n 


1 + Vn 


n— 1 


n|a n |(l + y n ) 


a—1 


We easily show that 
x-y 


1 + y 


< |x| if y is between 0 and x\ 


indeed, note y = xz for some z 6 [ 0 , 1 ], so 


x-y 


x — xz 


1 - z 

i + y 


1 + xz 


1 + xz 


< Id 


since 1 + xz > 1 — z. Therefore, (3) implies 

\R n (x)\ < \x\ n n\a n \(l + y^- 1 . 


( 3 ) 


The sequence (1 + y n ) a ~ 1 is bounded, because the continuous func¬ 
tion y —f (1 + y )"^ 1 is bounded on [— |x|, |x|], so from ( 2 ) and 
Exercise 8.4, we conclude lim n R n {x) = 0, so that (1) holds. ■ 


We next give an example of a function / whose Taylor series ex¬ 
ists but does not represent the function. The function / is infinitely 
differentiable on M, i.e., derivatives of all order exist at all points 
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y 



2 


3 


fix) =e~ llx for x > 0 


FIGURE 31.1 


of R. The example may appear artificial, but the existence of such 
functions [see also Exercise 31.4] is vital to the theory of distribu¬ 
tions, an important theory related to work in differential equations 
and Fourier analysis. 

Example 3 


Let f(x ) = e l / x for x > 0 and f(x) = 0 for x < 0; see Fig. 31.1. 
Clearly / has derivatives of all orders at all x ^ 0. We will prove 


/W(0) = 0 for n = 0,l,2,3,.... 


( 1 ) 


Hence the Taylor series for / is identically zero, so / does not agree 
with its Taylor series in any open interval containing 0. First we show 
for each n there is a polynomial p n of degree 2 n such that 


f( n \x) = e l ^ x p n {l/x) for x > 0. 


(2) 


This is obvious for n = 0; simply set po(t) = 1 for all t. And this is 
easy for n = 1 and n = 2; the reader should check (2) holds with 
n = 1 and pi{t) = t 2 and (2) holds with n = 2 and P 2 (t) = t 4 — 2 1 3 . 
To apply induction, we assume the result is true for n and write 


Pn(t) = a 0 + a±t + a 2 t 2 H-h a 2 „t 2 " where a 2n ^ 0. 


Then for i>0we have 


2 n 



lk=0 
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and a single differentiation yields 

2 n 


f {n+1 \x) = e -1 / 2 


°-E 


kctk 

v.fc+1 


k =1 


+ 


2 n 

E 

. fe =0 


Ofc 

,T fc 


=>-!/* . / 2 _ 


The assertion (2) is now clear for n + 1; in fact, the polynomial p n +i 
is evidently 


2 n 


Pn+l(t) = - ^2 ka k t k+1 + 


k =1 


2 n 


^2 a k t k 


,k =0 


0 t 2 ), 


which has degree 2n + 2. 

We next prove (1) by induction. Assume f^ n \ 0) = 0 for some 
n > 0. We need to prove 

lim AEEiEM = lim i/(»>(*) = 0 . 

a;—>o x — 0 »o x 

Obviously lim x ^ 0 - j/^(x) = 0 since f( n \x) = 0 for all a; < 0. By 
Theorem 20.10 it suffices to verify 

lim -/ (n) (x) = 0. 

Z-S-0+ X J 


In view of (2), it suffices to show 


lim e~ l / x q ( — 1=0 

*->• 0 + \x) 

for any polynomial q. In fact, since q(l/x) is a finite sum of terms of 
the form b k {l/x) k , where k > 0, it suffices to show 

lim ( — ) e~ l / x = 0 for fixed k > 0. 
a;—>0+ \X J 


As noted in Exercise 30.4, it suffices to show 

k 

lim y k e~ y = lim — = 0, 
y—> oo y—>• oo 


( 3 ) 


and this can be verified via k applications of L’Hospital’s Rule 30.2. 

□ 


As we observed in Remark 2.4 on page 12, Newton’s method 
allows one to solve some equations of the form f(x) = 0. 
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FIGURE 31.2 


31.8 Newton’s Method. 

Newton’s method for finding an approximate solution to /p) = 0 is 
to begin with a reasonable initial guess xq and then compute 


Xn — X n — i 


/On-1) 

/'On—l) 


for n > 1. 


Here x n is chosen so that p n ,0) lies on the line through 
On-ii/On-i)) having slope /'p n _i). See Fig. 31.2. Often the 
sequence (x n ) converges rapidly to a solution of /p) = 0. □ 


31.9 Secant Method. 

A similar approach to approximating solutions of f(x) = 0 is to start 
with two reasonable guesses xq and x\ and then compute 


%n — %n— 1 


/Pn-l)Pn.-2 X n -i) > n 

/On— 2 ) - /On—l) 


Here x n is chosen so that (x n , 0) lies on the line through 
On-i, /On— i)) and p n _ 2 , /(x n _ 2 )). See Fig. 31.3. □ 
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Example 4 

Consider the equation x 10 + x — 1 = 0. Let f(x) = x 10 + x — 1. 
The equation f(x) = 0 will have at least two solutions, because 
/(0) = -1 and lim a; _ >00 f(x) = lim^-oo f(x) = +oo. In fact, it 
has exactly two solutions, because f'{x) = IOj : 9 + 1 is 0 at only one 
point, y = — l/v^lo ~ —0.774, so that / decreases on (—oo ,y) and 
increases on (y, oo). 

We will illustrate both approximation methods, starting with 
Newton’s method. Since /(0) = —1 and /( 1 ) = 1 . a good initial 
guess for one of the solutions would be xq = 1. We omit the cal¬ 
culations, which we did on the spreadsheet Excel. With xq = 1 and 
Newton’s method, we obtained x\ ~ 0.909090909, X 2 ~ 0.852873482, 
x 3 » 0.836193375, x 4 ~ 0.835083481 and x 5 » 0.835079043. All sub¬ 
sequent approximations equaled xs’s, so this is surely the value to 
9-place accuracy. 

Since /(—1) = —1, the other solution is less than — 1 , and 
since /(— 2 ) = 1 , 021 , a good initial guess would be close to — 1 . 
But we started at xo = —2 to see what happens. We obtained 
xi » -1.800546982, x 2 » -1.621810423, x 3 « -1.462802078, 
x 4 ~ -1.324100397, x 5 « -1.209349769, x 6 w -1.126853632, 
x 7 « -1.085350048, x 8 » -1.076156798, x 9 » -1.075766739, and 
xio ~ —1.075766066. All further values of x n approximated x\q. Of 
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course, xq = —2 was a poor choice, and xq = — 1.2 would have been 
more sensible. With this choice, X 5 « —1.075766066. 

As we will see, with the secant method the convergence is a bit 
slower. To find the positive solution, we started with xq = 2 and 
x\ = 1. We obtained xg ~ 0.835079043, so it took about twice as 
many iterations to get 9-place accuracy as with Newton’s method. 
For the other solution, we started with xq = —2 and x\ = —1, and 
we obtained 9-place accuracy at xs ~ —1.075766066. If you look 
at a graph, you will see why choosing guesses on each side of the 
true solution can be efficient. If we had started with xo = — 2 and 
x\ = —1.5, we would not have reach 9-place accuracy until X 12 . □ 

Unlike much of calculus, there isn’t a single easily-found and 
easily-applied theorem justifying the use of either of these methods. 
We’ll prove two such theorems, Theorems 31.12 and 31.13. They 
might be of value when studying the theory or when writing a pro¬ 
gram to implement a method. But for simple problems, it is much 
more efficient to simply assume and hope that the method will suc¬ 
ceed, and then use common sense to assess whether the method 
worked. 

The secant method predates Newton’s method, but it does not 
seem as well known. In fact, the secant method is an example of 
the regula falsi (false position) method for approximating solutions 
of equations, which even appears in the Phind Papyrus attributed 
to the scribe Ahrnes. It works in many examples, but a computer 
implementation would need to avoid a premature attempt to divide 
by 0. One advantage to this method is that the derivatives of / 
might be very complicated or not even exist. Another advantage to 
this method is that it can be used to find approximate solutions 
of equations, like cosx — x = 0 , when studying functions in alge¬ 
bra or trigonometry. The methodology also might be useful when 
motivating the sequential definition of the derivative. 

We now work toward a theorem providing hypotheses that assure 
us that Newton’s method works. We will need a technical lemma 
about sequences. 
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31.10 Lemma. 

Let (a n ) be a sequence of nonnegative numbers, and let C and 5 be 
positive numbers satisfying C8 < 1. 

(a) If ao < 5 and a n < Cal_ 1 for n > 1, then 

a„ < (Cd) 2n ~ 1 ao for all n > 0. 

(b) If max{ao, ai} < 5 and a n < C max{a n _i, a n _ 2 } 2 for n > 2, 
then 


max{a 2 n, a 2 n+i} < (CS) 2 1 max{ao,ai} for all n > 0. 

Proof 

We prove (a) by mathematical induction, noting first that it is 
obvious for n = 0 and that ai < Coq < C5a$. In general, if 
a n < (C<5) 2 " _1 ao, then 

a n+ 1 < Cal < CKCtf) 2 " -1 ^] 2 < C 2n+1 ~ 1 5 2n+1 ~ 2 5ao = (Ctf) 2 "* 1-1 ^. 

For (b), we write M = max{ao,ai}, so that M <5 and we need 
to show 


max{a 2 n, 02 n+i} < ( CS) 2 i M for all n > 0. 

This is trivial for n = 0. In general, if we have max{a 2 n> 02 n+i} < 
(C'<5) 2 ™- 1 M, then 

a 2 n +2 < C max{o 2n -)_i,a 2n } 2 < C[(C8) 2n ~ 1 M] 2 


= C 2n+1 - l S 2n+1 ~ 2 M 2 < C 2n+1 -H 2n+1 - 2 SM = (C5) 2n+1 - l M, 


and 


a2n+3<C'max{a2n+2,02n+i} 2 <C'max{(C'(i) 2 " +1 1 M,(CS) 2 '" i M} 


\2 n -l 71 2 


< CKCS) 2 "- 1 M] 2 = C 2n+1 - 1 ? n+1 ~ 2 M* < C r 2B+1 - 1 * 2n+1 - 2 aM = (C6) an+1 ~ 1 M. 

Thus max{a 2 n+ 2 ) « 2 n+ 3 } < (C'<5) 2 " +1_1 M, and the induction proof 
of (b) is complete. ■ 
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31.11 Discussion. 

We assume / is defined and differentiable on an open interval J = 
( c,d ). A glance at the definition 



suggests it is reasonable to assume \f'\ is bounded away from 0 on J. 


This implies f is always positive or always negative [Intermediate 


Value Theorem for Derivatives 29.8 on page 236]. Therefore / is 
strictly increasing or strictly decreasing on J, and / is one-to-one 


[Corollary 29.7]. In addition, we assume f" exists on J and \f"\ is 


bounded above. 

Suppose there exists <5o > 0 with the property that f(x ) = 0 for 
some x in the closed interval I = [c + So, d — <5o] C J. We will show 
that if the initial value xo of Newton’s sequence is sufficiently close 
to x, then the iterates x n in Newton’s method converge to x. To 
see how this goes, we assume for now that each x n is indeed in the 
interval J. From the definition, we have 


f'(x n - 1 ) • (x n -i - x) - /(x n _j) 
f{x n - 1 ) 



x n ~ x = x n -i - x - 


By Taylor’s Theorem 31.3 on page 250, with n = 2, c = x n -\ and 
x = x, we obtain 



for some y n between x n -± and x. Hence 



so 



Therefore 


_ _ sup{|/"(x)| : x € J} 

Xn X ~ 2inf{|/ / (x)| : x € J} 



Xn — x\ < C\x n -i — X 


so that 
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where C = 2 inf{f/'(^)|-jgj} • Now se l ec t <5 > 0 so that C5 < 1. By 
Lemma 31.10(a), with a n = \x n — x\, we could conclude 

\x n — x\ < (C<5 ) 2 ” -1 \xq — x\ for all n > 0, (1) 

if we could arrange for \xq — x\ = < 5. 

The inequalities (1) are our goal, and would assure us the 
sequence (x n ) converges to x, but we need to backtrack and de¬ 
termine how to be sure each x n is in the interval J, as well as 
arrange for |to — x\ < <5. In addition to requiring C8 < 1, we 
will need to choose 5 so that 25 < So- Finally, we select To in 
/ so that |/(to)| < m 5 where m = inf{|/'(x)| : x E J}. Note 
(to — 2(5, xo + 2(5) C (xo — So, To + <5o) Q J ■ We also have 

It 0 - T| < (5, ( 2 ) 


because by the Mean Value Theorem 29.3, there is yo between To 
and t such that 


|t 0 - x 


l/Qco) ~ f( x ) I 

l/'(yo)| 


l/Oo)l \f(x 0 )\ 

\f'{yo)\ ~ rn 


By (1) and (2), for each n, we have \x n — x\ < \xp — x\ < 5; thus 
jx n — To | < \x n — t| + |t — xo | < 2(5, so that each x n is in the interval J. 
We summarize what we have. 


31.12 Theorem. 

Consider a function f having a zero x on an interval J = (c, d), and 
assume f" exists on J. Assume \f"\ is hounded above on J and \f'\ 
is bounded away from 0 on J. Choose 8 q > 0 so that I = [c + So, 
d — So] C J is a nondegenerate interval containing x and so that 
[c + So, d — <5o] C J. Let 

= sup{|/ // (.T)| : t E J} 

2 inf{|/'(T)| : x E J}’ 

and select 8 > 0 so that 25 < So and CS < 1. Let m = inf{|/'(x)| : 
t E J}. Consider any xp in I satisfying |/(xo)| < wi<5. Then the 
sequence of iterates given by Newton’s method, 

f(x n - 1 ) 

f'(x n - f) 


%n — %n— 1 


for n > 1 
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is a well-defined sequence and converges to x. Also, 

\x n — x\ < C\x n -\ — x\ 2 for n > 1, and (1) 

\x n — x\ < (C'd) 2 "~ 1 |xo — x\ for n > 0. (2) 

In view of (1), the convergence of (x n ) is said to be “quadratic 
convergence.” Here is an analogous theorem for the secant method. 
Comparing its conclusion with that in Theorem 31.12, it appears 
that it will take about twice as many iterations using the secant 
method to get the same accuracy as using Newton’s method. This is 
what happened in Example 4 on page 260. 


31.13 Theorem. 

Notation and hypotheses are as in Theorem 31.12, except we set 

= 3sup{|/"(a)| :i£J} 

2inf{|/'(x)| : x E J} ’ 

and we consider distinct xq and x\ in I satisfying 

max{|/(x 0 )|, \f(xi)\} < m8. ( 1 ) 

As before 8 > 0 is chosen so the 28 < do and C8 < 1 . 

The sequence (x n ) of iterates given by the secant method, 

f(Xn— 1) (Xn —2 %n— l) 


%n — %n— 1 


for n > 2 , 


(2) 


f{x n - 2 ) - f{x n - 1 ) 
is well defined and converges to x. Also, 

\x n — x\ < C ■ max{|x n _i — x\, \x n - 2 — x\} 2 for all n > 2 , (3) 

and for n > 0, we have 

max{\x 2n — x\,\x 2n+ i — x\}< (Cd ) 2 " -1 max{|x 0 - x\, \x\ - T|}. (4) 

Proof 

As in Discussion 31.11, (1) implies 

max{|xo — x\, \x\ — x|} < d. (5) 

Since 

_ f(x n -i)(x n - 2 - x n -i) 

x n -x = x n -i -x - — -r- - - 7 — for n > 2 , 

f[Xn-2) - f{X n - 1 ) 
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the Mean Value Theorem shows there is w n between x n -\ and x n -2 
so that 

_ f(x n ~i 

%n % — %n— 1 % n, / \ 

/'K) 


By Taylor’s Theorem 31.3 on page 250, with n = 2, c = x and 
x = x n -i, we have 


1 


—\2 


/On-1) = /O) + / 0) • (®ra-l - X) + -/ (y„) • On-1 “ 


= /'0) • On-1 - ») + ^/"On) • On-1 - x) * i 2 
for some y n between x n -\ and x. Hence 

_ , f O) • On-i ~ x) + f"(y n ) • On-i 

Xn - X = On—1 -x) - — -r- 

/'K 


x) 2 /2 


_ Qn-1 - x)f(w n ) - 00 ) • Q n _i ~ x) - /"(g/ n ) ~ Qn-1 ~ x) 2 /2 

f'(Wn ) 

®n-i -X [ , f"{y n ) ■ (x n -1 - s) 1 

= 7VT1 [/ ; (I)1 -^-J ■ 

By the Mean Value Theorem, applied to f, we obtain 

_ x n -!-x ( „ f"(y n ) ■ On-i -x) \ 

x n ~ x = U (z n )-(w n -x) - - -j ( 6 ) 

for some z n between w n and x. 

In general, a < c <b implies |c — x\ < max{|a — x\, \b — x|} for all 

i in R [Exercise 31.12]. Applying this, with a = min{x n _i, x n - 2 }, 
b = max{s n _i,s n _ 2 }, c = w n and x = x, we obtain 

\w n — x\< max{|x n _i - x\, \x n - 2 - T|}. 

Using this and ( 6 ), above we conclude 

, ^ 3sup{/"0) : x G J} 2 

\x n -x\< - . -——j- max{ Xn-i - x\, \x n - 2 - x } , 

2 mt{/'(x) : x E 

so that (3) holds. Substituting a n = \x n — x\ into (3) and (5), we see 
that Lemma 31.10(b) implies the inequalities in (4). Inequalities (4) 
and (5) imply \x n — xq\ < 25 for all n, so each x n is in J, as needed 
for the preceding argument. This completes the proof. ■ 
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Exercises 

31.1 Find the Taylor series for cosx and indicate why it converges to cos a; 
for all x £ R. 

31.2 Repeat Exercise 31.1 for the functions sinhx = \{e x — e~ x ) and 
coshx = |( e x + e~ x ). 

31.3 In Example 2, why did we apply Theorem 31.3 instead of Corol¬ 
lary 31.4? 

31.4 Consider a,b in R where a < b. Show there exist infinitely dif¬ 
ferentiable functions f a , gb, and h* b on M with the following 
properties. You may assume, without proof, that the sum, product, 
etc. of infinitely differentiable functions is again infinitely differen¬ 
tiable. The same applies to the quotient provided the denominator 
never vanishes. 

(a) f a (x) = 0 for x < a and f a (x) > 0 for x > a. Hint: Let f a (x) = 

f(x — a) where / is the function in Example 3. 

(b) gb(x) = 0 for x > b and gb(x) > 0 for x < b. 

(c) h a} b(x) > 0 for x £ (a, b) and h a ,b(x) = 0 for x £ (a, b). 

(d) h* b (x) = 0 for x < a and h* b (x) = 1 for x > b. Hint: Use the 

function -A f—. 

fa+gb 

31.5 Let g{x) = e _1 / x2 for x ^ 0 and g{ 0) = 0. 

(a) Show g (jl \ 0) = 0 for all n = 0,1,2, 3,.... Hint: Use Example 3. 

(b) Show the Taylor series for g about 0 agrees with g only at x = 0. 

31.6 An older proof of Theorem 31.3 goes as follows, which we outline for 
c = 0. Assume x > 0, let M be as in the proof of Theorem 31.3, and 
let 

F(<) = m + Y. + «• AAt 

fc =1 

for t in [0, x]. 

(a) Show F is differentiable on [0, x] and 

F'(t)= ix ~^ n i ~\ f ^(t)- M] . 
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(b) Show F( 0) = F(x). 

(c) Apply Rolle’s Theorem 29.2 to F to obtain y in (0, x) such that 

/(")(y)=M. 


31.7 Show the sequence in Exercise 9.5 comes from Newton’s method when 
solving /( x) = x 2 — 2 = 0. 

31.8 (a) Show x 4 + x J — 1 = 0 has exactly two solutions. 

(b) Use Newton’s method or the secant method to find the solutions 
to x 4 + x 3 — 1 = 0 to six-place accuracy. 


31.9 Exercise 18.6 asked for a proof that x = cosx for some x in (0, f). 
Use Newton’s method to find x to six-place accuracy. Hint: Apply 
Newton’s method to f(x) = x — cosx. 

31.10 Exercise 18.7 asked for a proof that xe x = 2 for some x in (0,1). Use 
Newton’s method to find x to six-place accuracy. 


31.11 Suppose / is differentiable on (a, b), f is bounded on (a, b), f never 
vanishes on (a,b), and the sequence (x n ) in (a, b) converges to x in 
(a, b). Show that if 


%n — %n— 1 


f{Xn- l) 

1 ) 


for all n > 1, 


then /( x) = 0. 


31.12 This result will complete the proof of Theorem 31.13. Show that if 
a < c < 6, then \c — x\ < max{|a — x\, \b — x\} for all itl. Hint: 
Consider two cases: x < c and x > c. 




Integration 



CHAPTER 


This chapter serves two purposes. It contains a careful development 
of the Riemann integral, which is the integral studied in standard 
calculus courses. It also contains an introduction to a generalization 
of the Riemann integral called the Riemann-Stieltjes integral. The 
generalization is easy and natural. Moreover, the Riemann-Stieltjes 
integral is an important tool in probability and statistics, and other 
areas of mathematics. 

§32 The Riemann Integral 

The theory of the Riemann integral is no more difficult than several 
other topics dealt with in this book. The one drawback is that it 
involves some technical notation and terminology. 

32.1 Definition. 

Let / be a bounded function on a closed interval [a, b]. 1 For S C [a, b ], 
we adopt the notation 


1 Hcre and elsewhere in this chapter, we assume a < b. 


K.A. Ross, Elementary Analysis: The Theory of Calculus, 
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M(f,S) = sup {f(x) : x € S} and m(f,S) = inf {f(x) : x € S}. 
A partition of [a, b] is any finite ordered subset P having the form 
P = {a = to < t\ < ■ ■ ■ < t n = b}. 

The upper Darboux sum U (/, P) of / with respect to P is the sum 

n 

u(f, p) = J2 M (/> [tk-i,t k ]) • (4 - tfc-i) 

k= 1 

and the lower Darboux sum L(f, P) is 

n 

L{f,P) = y~VCA [4-i,4]) • (4 - 4-i)- 

fe=i 

Note 

n 

U(f,P) [a,b ]) • (4 - 4-1) = M(/, [a, 6]) • (6 - a); 

k= 1 

likewise L(/, P) > m(/, [a, 6]) • (6 — a), so 

m(f , [a, 6]) ■ (6-a) < 4(/,P) < U(f,P) < M(f, [a,b ]) • (6-a). (1) 
The upper Darboux integral U (/) of / over [a, 6] is defined by 
£/(/) = inf{[/(/, P) : P is a partition of [a, 6]} 
and the lower Darboux integral is 

L(/) = sup{L(/, P) : P is a partition of [a, 6]}. 

In view of (1), U{f) and L(f ) are real numbers. 

We will prove in Theorem 32.4 that L{f) < U(f). This is not 
obvious from (1). [Why?] We say / is integrable on [a,b\ provided 
L(f ) = U{f). In this case, we write or j' r ' f(x) dx for this 
common value: 

I' f= f f(x)dx = L(f) = U(f). (2) 

J a J a 

Specialists call this integral the Darboux integral. Riemann’s def¬ 
inition of the integral is a little different [Definition 32.8], but we will 
show in Theorem 32.9 that the definitions are equivalent. For this 
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FIGURE 32.1 


reason, we will follow customary usage and call the integral defined 
above the Riemann integral. 

For nonnegative functions, f is interpreted as the area of the 
region under the graph of / [see Fig. 32.1] for the following reason. 
Each lower Darboux sum represents the area of a union of rectangles 
inside the region, and each upper Darboux sum represents the area of 
a union of rectangles that contains the region. Moreover, ff is the 
unique number that is larger than or equal to all lower Darboux sums 
and smaller than or equal to all upper Darboux sums. Figure 19.2 
on page 145 illustrates the situation for [a, b] = [0,1] and 


P = 


1 2 

0 < - < - < 
n n 


< 


n — 1 
n 



Example 1 

The simplest function whose integral is not obvious is f(x ) = x 2 . 
Consider / on the interval [0, b] where b > 0. For a partition 

P = {0 = t 0 < tl < ■ ■ ■ < t n = &}, 


we have 


U(f,P) = J>p{* 2 : x G [4_i, 4]}-(4-4-1) = y^fc(4-4_i). 

k =1 k =1 
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If we choose ti, = —, then we can use Exercise 1.1 to calculate 

ft, n 1 

k 2 b 2 ( b 


u(f,p) = j2 


k =1 


r 


n 


b 3 fr 3 n(n+l)(2n + l) 

3 / -/ 


71 ' 


k =1 




6 


For large n, this is close to y, so we conclude U(f) < C- For the 
same partition we find 

(k — l) 2 b 2 ( b\ b 3 (n — l)(n)(2n — 1) 


L(f,P) = J2 


k =1 




n 




6 


so L(f ) > y. Therefore f(x ) = x 2 is integrable on [0,6] and 
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3 ' 


Of course, any calculus student could have calculated this inte¬ 
gral using a formula that is based on the Fundamental Theorem of 
Calculus; see Example 1 in §34. □ 


Example 2 

Consider the interval [a, 6], where a < 6, and let f(x ) = 1 for rational 
x in [a, 6], and let f(x) = 0 for irrational x in [a, 6], For any partition 

P = {a = t 0 < t\ < ■ ■ ■ < t n = 6}, 


we have 

n n 

U(f,P) = [4-1,4]) • (4 -ife-i) = ^ l-(4-4-i) = b-a 

k= 1 k =1 

and 

n 

L(f , p) = o • (4 - 4 -i) = o. 

fc=l 

It follows that U(f) = 6 — a and L(f ) = 0. The upper and lower 
Darboux integrals for / do not agree, so / is not integrable! □ 


We next develop some properties of the integral. 
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32.2 Lemma. 

Let f be a bounded function on [a,b\. If P and Q are partitions of 
[a, b] and PCQ, then 

L(f , P) < L(f, Q) < U(f, Q) < U(f, P ). (1) 

Proof 

The middle inequality is obvious. The proofs of the first and third 
inequalities are similar, so we will prove 

L(f, P) < L(f, Q). (2) 

An induction argument [Exercise 32.4] shows we may assume 
Q has only one more point, say u, than P. If 

P = {a = t 0 < h < ■ ■ ■ < t n = b}, 

then 


Q = {a = t 0 < ti <■■■ < tk-i < u < tk < ■ ■ ■ < t n = b} 

for some k e {1,2,... ,n}. The lower Darboux sums for P and Q 
are the same except for the terms involving tk -1 or tk- In fact, their 
difference is 

L(f, Q) ~ L(f, P) = m(f, [t k - 1 , u])-(u- t k - 1 ) + m(f, [u, t k ]) ■ (t k - u) 

-m(f, [tk-i,tk]) ■ (t k - t k ~i). (3) 


To establish (2) it suffices to show this quantity is nonnegative. Using 
Exercise 4.7(a), we see 

i [tk— 1) tk]') ' (tk tk— l) 

= m(f, [t k -i,t k ]) ■ {(4 -u) + (u- t k - 1 )} 

< m(f, [u,t k ]) • (4 -u) + m(f,[t k - 1 ,u\) ■ (u-tk-i). m 


32.3 Lemma. 

If f is a bounded function on [a, 61, and if P and Q are partitions of 
[a, 6] , then L(f, P) < U(f,Q). 

Proof 

The set P U Q is also a partition of [a,b]. Since P C P U Q and 
Q C P U Q, we can apply Lemma 32.2 to obtain 

L(f, P) < L(f, PUQ)< U(f, PUQ)< U(f, Q ). 
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32.4 Theorem. 

If f is a bounded function on [a,b\, then L(f) < U(f). 

Proof 

Fix a partition P of [a, b]. Lemma 32.3 shows L(f,P) is a lower 
bound for the set 

{[/(/, Q) : Q is a partition of [a, 6]}. 

Therefore L(f,P) is less than or equal to the greatest lower bound 
[infimum!] of this set. That is 

L(f,P)<U(f). (1) 

Now (1) shows that U(f) is an upper bound for the set 

{L(f, P) : P is a partition of [a, b}}, 

so [/(/) > L(f). m 


Note that Theorem 32.4 also follows from Lemma 32.3 and Ex¬ 
ercise 4.8; see Exercise 32.5. The next theorem gives a “Cauchy 
criterion” for integrability. 


32.5 Theorem. 

A bounded function f on [a, b] is integrable if and only if for each 
e > 0 there exists a partition P of [a, b] such that 

U(f,P) — L(f,P) < e. (1) 

Proof 

Suppose first that / is integrable and consider e > 0. There exist 
partitions Pi and P 2 of [a, b] satisfying 

L(/,Pi)>L(/)-| and U(f,P 2 )<U(f) + ^. 

For P = Pi U P 2 , we apply Lemma 32.2 to obtain 


U(f,P) - L(f,P) < U(f,P 2 )-L(f,P I ) 




m - - 2i 


U(})-L(f)+e. 


Since / is integrable, U(f) = L(f), so (1) holds. 
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Conversely, suppose for e > 0 the inequality (1) holds for some 
partition P. Then we have 

U(f) < U{f , P) = U(f, P ) - L(f, P) + L(f , P ) 

< e + L(f,P) < e + L{f). 

Since e is arbitrary, we conclude U (/) < L(/). Hence we have U (/) = 
L(f) by Theorem 32.4, i.e., / is integrable. ■ 

The remainder of this section is devoted to establishing the 
equivalence of Riemann’s and Darboux’s definitions of integrabil- 
ity. Subsequent sections will depend only on items Definition 32.1 
through Theorem 32.5. Therefore the reader who is content with the 
Darboux integral in Definition 32.1 can safely proceed directly to the 
next section. 

32.6 Definition. 

The mesh of a partition P is the maximum length of the subintervals 
comprising P. Thus if 

P = {a = t 0 < h < ■ ■ ■ < t n = b}, 

then 

mesh(i :> ) = maxjffc — f^-i : k = 1,2,..., n}. 


Here is another “Cauchy criterion” for integrability. 

32.7 Theorem. 

A bounded function f on [a, b] is integrable if and only if for each 
e > 0 there exists a 5 > 0 such that 

mesh(P) < 5 implies U(f,P) — L(f,P) < e (1) 

for all partitions P of [a,b\. 

Proof 

The e—S condition in (1) implies integrability by Theorem 32.5. 

Conversely, suppose / is integrable on [a, b\. Let e > 0 and select 
a partition 

Po = {a = uq < u\ <■■■< u m = b} 
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of [a, b] such that 

P(/,P 0 )-L(/,P 0 )<|. (2) 

Since / is bounded, there exists B > 0 such that |/(x)| < B for all 
x £ [a, b\. Let 5 = 171 the number of intervals comprising Pq. 

To verify (1), we consider any partition 

P = {a = to < t\ <■■■< t n = b} 

with mesh(P) < 6. Let Q = P U Pq. If Q has one more element 
than P, then a glance at (3) in the proof of Lemma 32.2 leads us to 

L(f, Q) — L(f, P) < B ■ mesh(P) — (— B) ■ mesh(P) = 2 B ■ mesh(P). 

Since Q has at most m elements that are not in P, an induction 
argument shows 

L(f, Q ) - L(/, P) < 2 mB ■ mesh(P) < 2 mB5 = 

By Lemma 32.2 we have L(f , Pq) < L(f, Q), so 
L(f,Po) — L(f, P) < -. 

Similarly 

U(f,P) -U(f,P 0 ) < 
so 

U(f , P) - L(f, P ) < U(f , P 0 ) - L(f, P 0 ) + 

Now (2) implies U(f , P) — L(f, P) < e and we have verified (1). ■ 

Now we give Riemann’s definition of integrability. 

32.8 Definition. 

Let / be a bounded function on [a, b], and let P = {a = to < t\ < 
■ ■ ■ < t n = b} be a partition of [a, b], A Riemann sum of / associated 
with the partition P is a sum of the form 

n 

f(xk){t k - t k - 1) 

fc=i 
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where x k 6 [t k -i,t k ] for k = 1,2 ,... ,n. The choice of x k s is quite 
arbitrary, so there are infinitely many Riemann sums associated with 
a single function and partition. 

The function / is Riemann integrable on [a, b] if there exists a 
number r with the following property. For each e > 0 there exists 
8 > 0 such that 


\S — r\ < e (1) 

for every Riemann sum S of / associated with a partition P having 
mesh(P) < 8. The number r is the Riemann integral of / on [a, b] 
and will be provisionally written as 1Z f. 


32.9 Theorem. 

A bounded function f on [a, b] is Riemann integrable if and only if 
it is [Darboux ] integrable, in which case the values of the integrals 
agree. 


Proof 

Suppose first that / is [Darboux] integrable on [a, 6] in the sense of 
Definition 32.1. Let e > 0, and let 8 > 0 be chosen so that (1) of 
Theorem 32.7 holds. We show 



( 1 ) 


for every Riemann sum 


S = y^f(x k )(t k - 4_i) 

k =1 


associated with a partition P having mesh(P) < 8. Clearly we have 
L(f,P ) < S < U(f,P), so (1) follows from the inequalities 


and 


U(f,P)<L(f,P) + e<L(f) + e 



f + e 



— e. 


L(f,P) > U(f,P) — e> U(f) — e = 
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This proves (1); hence / is Riemann integrable and 



Now suppose / is Riemann integrable in the sense of Defini¬ 
tion 32.8, and consider e > 0. Let 5 > 0 and r be as given in 
Definition 32.8. Select any partition 


P = {a = to < t\ <■■■< t n = b} 


with mesh(P) < 5, and for each k = 1, 2,..., n, select Xk in [4_i, 4] 
so that 

f(xk) < m{f , [4_i,4]) + e. 

The Riemann sum S for this choice of x^s satisfies 

S<L(f,P) + e(b-a) 

as well as 


|5 — r| < e. 


It follows that 


L(/) > L(f, P) > S — e{b — a) > r — e — e(b — a). 

Since e is arbitrary, we have L(f) > r. A similar argument shows 
U(f) < r. Since L(f) < U(f ), we see L(f) = [/(/)= r. This shows 
/ is [Darboux] integrable and 



32.10 Corollary. 

Let f be a bounded Riemann integrable function on [a, b\. Suppose 
(S n ) is a sequence of Riemann sums, with corresponding partitions 
P n , satisfying lim„ mesh(P n ) = 0. Then the sequence (S n ) converges 
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Proof 

Let e > 0. There is a S > 0 so that if S is a Riemann sum with 
corresponding partition P, and if mesh(P) < 5 , then 



Choose N so that mesh(P n ) < <5 for n > N. Then 
S n — < e for n > N. 



Since e > 0 is arbitrary, this shows lim n S n = f ( ’ f. 


32.11 Remark. 

I recently had occasion to use the following simple observation. If 
one ignores the end intervals of the partitions, the “almost Riemann 
sums” so obtained still converge to the integral; see [59]. This arose 
because the intervals had the form [a, b\, but the partition points had 
the form -. Thus the partition points were nice and equally spaced, 
except for the end ones. 

Exercises 

32.1 Find the upper and lower Darboux integrals for f(x) = x 3 on the 
interval [0,6]. Hint : Exercise 1.3 and Example 1 in §1 will be useful. 

32.2 Let f(x) = x for rational x and f(x) = 0 for irrational x. 

(a) Calculate the upper and lower Darboux integrals for / on the 
interval [0,6]. 

(b) Is / integrable on [0,6]? 

32.3 Repeat Exercise 32.2 for g where g(x) = x 2 for rational x and 
g(x) = 0 for irrational x. 

32.4 Supply the induction argument needed in the proof of Lemma 32.2. 

32.5 Use Exercise 4.8 to prove Theorem 32.4. Specify the sets S and T in 


this case. 
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32.6 Let / be a bounded function on [a, b\. Suppose there exist sequences 
(U n ) and ( L n ) of upper and lower Darboux sums for / such that 
lim (U n — L n ) = 0. Show / is integrable and f a f = lim U n = \m\L n . 

32.7 Let / be integrable on [a, b], and suppose g is a function on [a, b] 
such that g(x ) = f(x ) except for finitely many x in [a, b]. Show g is 
integrable and J ^ / = / Q b g. Hint: First reduce to the case where / is 
the function identically equal to 0. 

32.8 Show that if / is integrable on [a, 6], then / is integrable on every 
interval [c, d] C [o, b\. 


§33 Properties of the Riemann Integral 

In this section we establish some basic properties of the Riemann 
integral and we show many familiar functions, including piece- 
wise continuous and piecewise monotonic functions, are Riemann 
integrable. 

A function is monotonic on an interval if it is either increasing 
or decreasing on the interval; see Definition 29.6. 


33.1 Theorem. 

Every monotonia function f on [a, b] is integrable. 


Proof 

We assume / is increasing on [a, b] and leave the decreasing case to 
Exercise 33.1. We also assume /(a) < /(&), since otherwise / would 
be a constant function. Since /(a) < f(x) < f(b) for all x £ [a, 6], 
/ is clearly bounded on [a, b\. In order to apply Theorem 32.5, let 
e > 0 and select a partition P = {a = to < t\ <■■■< t n = b} with 


mesh less than 


f(b)-f(a ) 


. Then 


U(f, P ) - L(f, P) = [4-i,h]) - m(f, [4-i,4])} • (4 - 4-i) 

k= 1 

n 

= - /(4-i)] • (4 - 4-i). 

k= 1 




§33. Properties of the Riemann Integral 281 


Since mesh(P) < we have 

n 

U(f, P ) - L(f, P ) < ]T[/(4) - /(4-1)] • f{b) E _ /(o) 

= [/(,>> - /<a)l ' 7WTW) = e - 

Theorem 32.5 now shows / is integrable. ■ 

33.2 Theorem. 

Every continuous function f on [a, b] is integrable. 

Proof 

Again, in order to apply Theorem 32.5, consider e > 0. Since / is 
uniformly continuous on [a,b\ by Theorem 19.2, there exists 5 > 0 
such that 

x,y€[a,b\ and \x - y\ < 6 imply \f(x) - f(y)\ < —. (1) 

b — a 

Consider any partition P = {a = to < t\ <■■■< t n = b} where 

ma x{tk — tk~i ■ k = 1,2,..., n} < S. 

Since / assumes its maximum and minimum on each interval 
[tk—i,tk] by Theorem 18.1, it follows from (1) above that 

M(f, [4-1,4]) - m(f, [4-1,4]) < 7—— 

b — a 

for each k. Therefore we have 

n 

U(f, P) - L(f, P) < V - 4-1) - e, 

and Theorem 32.5 shows / is integrable. ■ 

33.3 Theorem. 

Let f and g be integrable functions on [a,b\, and let c be a real 
number. Then 

(i) cf is integrable and J ^ cf = c f: 

(ii) / + 9 is integrable and J*(f + g) = f + g. 
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Exercise 33.8 shows fg , max(/, g) and min (f,g) are also inte¬ 
gral) le, but there are no formulas giving their integrals in terms of 

la f and fa 9- 


Proof 

The proof of (i) involves three cases: c > 0, c = —1, and c < 0. Of 
course, (i) is obvious for c = 0. 

Let c > 0 and consider a partition 


P = {a = to < t\ <■■■< t n = b} 
of [a, 6]. A simple exercise [Exercise 33.2] shows 


M(cf, [t k -i,t k ]) =c- M(/, [4_i,4]) 

for all k , so U(cf,P) = c ■ U(f,P). Another application of the 
same exercise shows U(cf) = c ■ U(f). Similar arguments show 
L(cf) = c ■ L{f). Since / is integrable, we have L(cf) = c-L(f) = c- 
U(f ) = U(cf). Hence cf is integrable and 

[ cf = U(cf) = c-U(f) = c f /, O 0. (1) 

J a J a 

Now we deal with the case c = —1. Exercise 5.4 implies 
U(—f,P) = —L(f,P) for all partitions P of [a,b\. Hence we have 

U(—f) = inf{[/(—/, P) : P is a partition of [a, b]} 

= inf{— L(f, P) : P is a partition of [a, b]} 

= — sup {L(f,P) : P is a partition of [a, 6]} = —L(f). 


Replacing / by —/, we also obtain L(—f) = —U(f). Since / is inte¬ 
grable, U(—f ) = —L(f) = —U(f) = L{—f)\ hence —/ is integrable 
and 




/• 


The case c < 0 is handled by applying (2), and then (1) to —c: 




(-c)/ 




/• 


(2) 
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To prove (ii) we will again use Theorem 32.5. Let e > 0. By 
Theorem 32.5 there exist partitions Pi and P 2 of [a, b] such that 

t/(/,P 1 )-L(/,P 1 )<| and U(g,P 2 )-L(g,P 2 )<^. 

Lemma 32.2 shows that if P = P\ U P 2 , then 

U(f,P) — L(f,P) < ^ and U(g,P)-L(g,P)< |. (3) 

For any subset S of [ a,b ], we have 
inf{/(x) + g(x) : x £ 5} > inf{/(x) : x £ 5} + inf{g(x) : x £ S}, 
i.e., m(f + g, S) > m(f, S ) + m(g, S ). It follows that 
L(f + g,P)>L(f,P) + L(g,P) 
and similarly we have 


U(f + g,P) <U(f,P) + U(g,P). 

Therefore from (3) we obtain 

U(f + g,P)-L(f + g,P)<e. 

Theorem 32.5 now shows f + g is integrable. Since 

[ (f + 9) = U{f + g)< U(f + g,P) < U{f, P) + U{g, P) 

J a 

< L(f , P) + L(g, P) + e < L(f) + L(g) + e = f f+f 5 + e 

J a J a 


and 

rb 


[ (f + 9)= L(f + g)> L(f + g,P) > L(f, P) + L(g , P) 

J a 

>U(f,P) + U(g,P) — e> U(f) + U(g) — e= f f + [ g - e, 

J a J a 




we see that 
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33.4 Theorem. 

(i) If f and g are integrable on [a,b\ and if f(x) < g(x) for x in 
[a,b], then f*f< f*g. 

(ii) If g is a continuous nonnegative function on [a, b\ and if 
f^g = 0, then g is identically 0 on [a, b\. 


Proof 

(i) By Theorem 33.3, h = g — f is integrable on [a, b\. Since 
h(x) > 0 for all x 6 [a, b], it is clear that L(h,P) > 0 for 
all partitions P of [a, b], so f^h = L{h) > 0. Applying 
Theorem 33.3 again, we see 




/• 


(ii) Otherwise, since g is continuous, there is a nonempty interval 
(c,d) C [a, b] and a > 0 satisfying g(x) > a/2 for x € (c,d). 
Then 

f b f d a 
J 9> J 9> 2^ d ~ c ) > °> 

contradicting f^g = 0. ■ 


33.5 Theorem. 

If f is integrable on [a, b\, then \ f\ is integrable on [a,b] and 



(1) 


Proof 

This follows easily from Theorem 33.4 (i) provided we know |/| is 
integrable on [a, 6]. In fact, —\f\ < f < |/|; therefore 

rb rb rb 

- I/I < / /< / I/I, 

J a J a J a 

which implies (1). 

We now show |/| is integrable, a point that was conveniently 
glossed over in Exercise 25.1. For any subset S of [a, 6], we have 


M(|/|, S) - m(|/|, S) < M(f, S ) - m(f, S ) 


(2) 
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by Exercise 33.6. From (2) it follows that 

U(\f\,P) - L(\f\,P) < U(f,P) — L(f,P) (3) 

for all partitions P of [ a,b\ . By Theorem 32.5, for each e > 0 there 
exists a partition P such that 

U(f,P) — L(f,P) < e. 

In view of (3), the same remark applies to |/|, so |/| is integrable by 
Theorem 32.5. ■ 

33.6 Theorem. 

Let f be a function defined on [a, b]. If a < c < b and f is integrable 
on [a,c] and on [c,b\, then f is integrable on [a, 6] and 

rb rc rb 

f= f+ / /■ (i) 

J a J a J c 

Proof 

Since / is bounded on both [a, c] and [c, 6], / is bounded on [a, b]. In 
this proof we will decorate upper and lower sums so that it will be 
clear which intervals we are dealing with. Let e > 0. By Theorem 32.5 
there exist partitions Pi and P 2 of [a, c] and [c, b] such that 

U c a (f,P 1 )-L c a (f,P 1 )< ( 2 and U b c (f,P 2 )-L b c (f,P 2 )< e -. 

The set P = Pi U P 2 is a partition of [a, b], and it is obvious that 

U b (fiP) = U c a (f,Pi) + U b (f,P2 ) (2) 

with a similar identity for lower sums. It follows that 
U b (f,P)~L b a (f,P)<e , 

so / is integrable on [a, 6] by Theorem 32.5. Also (1) holds because 

ff< u b (f ,p) = p a c (/,Pi) + u b c (f, p 2 ) 

J a 

<L c a (f,P 1 ) + L b (f,P 2 ) + e< f /+ [ b f + e 

J a J c 


and similarly j b f > £ f + [ b f - e. 
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Most functions encountered in calculus and analysis are covered 
by the next definition. However, see Exercises 33.10-33.12. 

33.7 Definition. 

A function / on [a, 6] is piecewise monotonic if there is a partition 
P = {a = to < t\ <■■■< t n = b} 

of [a, b] such that / is monotonic on each interval (4-i,4)- The 
function / is piecewise continuous if there is a partition P of [a, b] 
such that / is uniformly continuous on each interval ( 4 - 1 , 4 )- 

33.8 Theorem. 

If f is a piecewise continuous function or a bounded piecewise 
monotonic function on [a, 6], then f is integrable on [a,b\. 

Proof 

Let P be the partition described in Definition 33.7. Consider a fixed 
interval [4-i,4]- If / is piecewise continuous, then its restriction to 
(4-1,4) can be extended to a continuous function 4 on [4-i,4] 
by Theorem 19.5. If / is piecewise monotonic, then its restriction to 
(4-i,4) can be extended to a monotonic function 4 on [4-i,4]> 
for example, if / is increasing on ( 4 - 1 , 4 ), simply define 

4(4) = sup {f(x) : x € (4_i,4)} 


and 


4(4-i) = inf {f{x) : x <E (4-1,4)}- 

In either case, 4 is integrable on [4-1,4] by Theorem 33.1 or 33.2. 
Since / agrees with 4 on [4-i,4] except possibly at the endpoints, 
Exercise 32.7 shows / is also integrable on [4—1,4]- Now Theo¬ 
rem 33.6 and a trivial induction argument show / is integrable on 
[a, 6], ■ 


We close this section with a simple but useful result. 
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33.9 Intermediate Value Theorem for Integrals. 

If f is a continuous function on [a, b], then for at least one x in (a, b ) 
we have 



Proof 

Let M and m be the maximum and minimum values of / on [a, b]. 
If m = M, then / is a constant function and f(x) = f for 

all x £ [o, b\. Otherwise, m < M and by Theorem 18.1. there exist 
distinct xq and yo in [a, b] satisfying f(x o) = m and /(yo) = M . Since 
each function M — f and / — m is nonnegative and not identically 0, 
Theorem 33.4(h) shows f < M. Thus 

1 f b 

m < -- / f < M, 

b~a J a 

and by the Intermediate Value Theorem 18.2 for continuous func¬ 
tions, we have f(x) = 5 ^ J / for some x between xq and yo- Since 
x is in (a, b), this completes the proof. ■ 

33.10 Discussion. 

An important question concerns when one can interchange limits and 
integrals, i.e., when is 

rb rb 

lim / f n (x)dx= / lim f n {x)dx ( 1 ) 

n->oo J a J a n—>oo 

true? By Theorems 24.3 and 25.2, if the f n s are continuous and 
converge uniformly to / = lim n ^, 00 f n on [a, 6], then / is continuous 
and (1) holds. It turns out that if each f n is just Riemann integrable 
and fn—tf uniformly, then / is Riemann integrable and (1) holds; 
see Exercise 33.9. What happens if f n —> ./’ pointwise on [a, 6 ]? One 
problem is that / need not be integrable even if it is bounded and 
each f n is integrable. 

Consider, for example, the non-integrable function / in Exam¬ 
ple 2 on page 272: f(x) = 1 for rational x in [a, b] and f(x) = 0 for 
irrational x in [a, 6 ]. Let (xk)k£N be an enumeration of the rationals 
in [a, 6 ], and define f n {xk) = 1 for 1 < k < n and f n {x) = 0 for 
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all other x in [a,b\. Then / n —> / pointwise on [a,b\, and each f n is 
integrable. 

This example leaves open the possibility that (1) will hold pro¬ 
vided all the functions f n and the limit function / are integrable. 
However, Exercise 33.15 provides an example of a sequence (f n ) of 
functions on [0,1] converging pointwise to a function /, with all the 
functions integrable, and yet (1) does not hold. Nevertheless, there 
is an important theorem that does apply to sequences of functions 
that converge pointwise. □ 

33.11 Dominated Convergence Theorem. 

Suppose (f n ) is a sequence of integrable functions on [a, b] and f n —> 
/ pointwise where f is an integrable function on [a, b\. If there exists 
an M > 0 such that \ f n (x)\ < M for all n and all x in [a, b\, then 



We omit the proof. An elementary proof of the Dominated Con¬ 
vergence Theorem is given by Jonathan W. Lewin [42]. Here is a 
corollary. 

33.12 Monotone Convergence Theorem. 

Suppose (f n ) is a sequence of integrable functions on [a, b\ such that 
fi(x) < f 2 (x) < ••• for all x in [a, b\. Suppose also that f n —> / 
pointwise where f is an integrable function on [a, b]. Then 



This follows from the Dominated Convergence Theorem, because 
there exists an M > 0 such that \fi(x)\ < M and also |/(x)| < M 
for all x in [a, b\. This implies \f n (x)\ < M for all n and all x in [a, b ], 
since — M < fi(x) < f n (x) < M for all x. 

Our version of the Dominated Convergence Theorem is a spe¬ 
cial case of a much more general theorem, which is usually stated 
and proved for the family of all “Lebesgue integrable functions,” 
not just for Riemann integrable functions. There is also a Monotone 
Convergence Theorem for Lebesgue integrable functions, but in that 
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generality it does not follow immediately from the Dominated Con¬ 
vergence Theorem, because in that setting integrable functions need 
not be bounded. An elementary proof of the Monotone Convergence 
Theorem is proved for Riemann integrable functions, without resort 
to Lebesgue theory, by Brian S. Thomson [67]. 


Exercises 

33.1 Complete the proof of Theorem 33.1 by showing that a decreasing 
function on [o, b\ is integrable. 

33.2 This exercise could have appeared just as easily in §4. Let S be a 
nonempty bounded subset of K. For fixed c > 0, let cS = {cs : s £ S}. 
Show sup(cS') = c • sup(S) and inf(c5) = c • inf (S'). 

33.3 A function / on [a, b] is called a step function if there exists a partition 

P = {o = uq < u\ < ■ ■ ■ < c m = b} of [a, b] such that / is constant 
on each interval say f(x) = Cj for x in (uj-i,Uj). 

(a) Show that a step function / is integrable and evaluate / Q 6 /. 

(b) Evaluate the integral J () 4 P{x) dx for the postage-stamp function 
P in Exercise 17.16. 

33.4 Give an example of a function / on [0,1] that is not integrable for 
which |/| is integrable. Hint : Modify Example 2 in §32. 

33.5 Show | flin X<1 sin 8 ^*) dx\ < -^y-- 

33.6 Prove (2) in the proof of Theorem 33.5. Hint : For xo, yo € S, we have 
\f(xo)\ ~ \f(yo)\ < \f(x 0 ) - f(yo)\ < M(f, S ) - m(f, S). 

33.7 Let / be a bounded function on [a, 6], so that there exists B > 0 such 
that |/(x)| < B for all x £ [a, b}. 

(a) Show 

U(f 2 ,P) - L(f 2 , P) < 2 B[U(f, P) - L(f, P)} 
for all partitions P of [a, b\. Hint : f{x) 2 — f(y) 2 = [f{x) + f(y)] ■ 

lf(x) - f(y)}- 

(b) Show that if / is integrable on [a, b] , then f 2 also is integrable 
on [a, b). 
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33.8 Let / and g be integrable functions on [a, b]. 

(a) Show fg is integrable on [a, b]. Hint: Use Exercise 33.7 and 4 fg = 

(/ + s) 2 -(/-s) 2 . 

(b) Show max(/,j) and min(/, g) are integrable on [a, b\. Hint: 
Exercise 17.8. 


33.9 Let ( f n ) be a sequence of integrable functions on [a, b], and suppose 
fn~>f uniformly on [a, b]. Prove / is integrable and 




fn- 


Compare this result with Theorems 25.2 and 33.11. 


33.10 Let f{x) = sin L for x ^ 0 and /(0) = 0. Show / is integrable on 
[—1,1]. Hint: See the answer to Exercise 33.11(c). 

33.11 Let f(x) = x sgn(sin |) for x ^ 0 and /(0) = 0. 

(a) Show / is not piecewise continuous on [—1,1]. 

(b) Show / is not piecewise monotonic on [—1,1]. 

(c) Show / is integrable on [—1,1]. 

33.12 Let / be the function described in Exercise 17.14. 

(a) Show / is not piecewise continuous or piecewise monotonic on 
any interval [a, b], 

(b) Show / is integrable on every interval [a, b] and f ^ / = 0. 


33.13 Suppose / and g are continuous functions on [a, 6 ] such that J ^ / = 
/ Q b g. Prove there exists x in (a, b) such that f(x) = g{x). 

33.14 (a) Prove the following generalization of the Intermediate Value The¬ 

orem for Integrals. If / and g are continuous functions on [a, b} 
and g(t) > 0 for all t G [a, b], then there exists x in (a, b) such 
that 

pb pb 

/ f(t)g{t)dt = f{x) / g{t)dt. 

J a J a 

(b) Show Theorem 33.9 is a special case of part (a). 

(c) Does the conclusion in part (a) hold if [a, b] = [—1,1] and /(f) = 
g{t) = t for all t? 
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33.15 For integers n > 3, define the function f n on [0,1] by the rules: 

fn (0) = fn(~) = /n(l) = 0 and fn = 71, 

and so that its graph is a straight line from (0,0) to (-,n), from 

(b n ) t0 (|>°). and from (f>°) t0 (!,0). 

(a) Graph / 3 , / 4 and f 5 . 

(b) Show f n —> 0 pointwise on [0,1]. 

(c) Show linin lj f n (x)dx ^ J Q 0 dx . Why doesn’t this contradict 
the Dominated Convergence Theorem? 


§34 Fundamental Theorem of Calculus 

There are two versions of the Fundamental Theorem of Calculus. 
Each says, roughly speaking, that differentiation and integration are 
inverse operations. In fact, our first version [Theorem 34.1] says “the 
integral of the derivative of a function is given by the function,” 
and our second version [Theorem 34.3] says “the derivative of the 
integral of a continuous function is the function.” It is somewhat 
traditional for books to prove our second version first and use it to 
prove our first version, although some books do avoid this approach. 
F. Cunningham, Jr. [18] offers some good reasons for avoiding the 
traditional approach: 

(a) Theorem 34.3 implies Theorem 34.1 only for functions g whose 
derivative g' is continuous; see Exercise 34.1. 

(b) Making Theorem 34.1 depend on Theorem 34.3 obscures the 
fact that the two theorems say different things, have different 
applications, and may leave the impression Theorem 34.3 is the 
fundamental theorem. 

(c) The need for Theorem 34.1 in calculus is immediate and easily 
motivated. 

In what follows, we say a function h defined on (a, b ) is integrable 
on [a, 5] if every extension of h to [a, b\ is integrable. In view of 
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Exercise 32.7, the value f a h will not depend on the values of the 
extensions at a or b. 


34.1 Fundamental Theorem of Calculus I. 

If g is a continuous function on [a,b] that is differentiable on ( a,b ), 
and if g' is integrable on [a,b], then 

[ g' = g{b) - g{a). ( 1 ) 

J a 

Proof 

Let e > 0. By Theorem 32.5, there exists a partition P = {a = to < 
t\ < ■ ■ ■ < t n = b} of [a, 6] such that 


U(g',P)-L(g , ,P)<e. 


(2) 


We apply the Mean Value Theorem 29.3 to each interval [tk-i, tk] to 
obtain xk in (ffc_i,ifc) for which 

(4 - tk-i)g'(xk) = g{tk) - g(t k -i). 

Hence we have 

n n 

g{b) - g{a) = ^b(4) - ff(4- 1 )] = ^g'{x k ){t k - t k _ i). 

k=1 k =1 

It follows that 

L{g',P) < g(b) - g{a) < U(g',P)\ 


( 3 ) 


see Dehnition 32.1. Since 


L(g',P)< / g'<U(g',P), 

J a 

inequalities (2) and (3) imply 

r g' - [g(b) - 5 (a)] < e. 

a 

Since e is arbitary, (1) holds. ■ 

The integration formulas in calculus all rely in the end on 
Theorem 34.1. 
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Example 1 

If g{x) = then g'(x) = x n , so 



In particular, 


b n+i a n+1 

n + 1 n + 1 


b n+ 1 - a n+1 
n + 1 


( 1 ) 



b 3 — a 3 


3 


yj_|_ ^ 

Formula (1) is valid for any powers n for which g(x) = x n . 1 is 
dehned on [a,b\. See Examples 3 and 4 in §28 and Exercises 29.15 
and 37.5. For example, 



~[6 3 / 2 - a 3 / 2 ] for 0 < a < b. 
3 


□ 


34.2 Theorem [Integration by Parts]. 

If u and v are continuous functions on [a, 6] that are differentiable 
on ( a,b ), and if u 1 and v 1 are integrable on [ a,b ], then 


rb rb 

u{x)v'{x)dx+ / u'(x)v(x) dx = u(b)v(b) — u(a)v{a). (1) 


Proof 

Let g = uv, then g' = uv' + u'v by Theorem 28.3. Exercise 33.8 shows 
g' is integrable. Now Theorem 34.1 shows 



g'(x) dx = g{b) - g{a) 


u(b)v(b ) — u(a)v(a), 


so (1) holds. 


Note the use of Exercise 33.8 above can be avoided if u' and v' 
are continuous, which is normally the case. 


Example 2 

Here is a simple application of integration by parts. To calculate 
fyxcosxdx, we note the integrand has the form u(x)v'(x) where 
u(x) = x and v{x) = sinx. Hence 
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xcosxdx = u(tt)v(tt) — u(0)w(0)— / l-sinxdx = — / sin xdx 


f 

Jo 


- 2 . 

□ 


In what follows we use the convention 



Jb / for a > b. 


34.3 Fundamental Theorem of Calculus II. 

Let f be an integrable function on [a,b ]. For x in [a,b ], let 

F{x)= f f(t)dt. 

J a 

Then F is continuous on [a,b\. If f is continuous at xo in ( a,b), then 
F is differentiable at xo and 

F'{x 0 ) = f{x 0 ). 


Proof 

Select B > 0 so that \ f(x)\ < B for all x E [a, b]. If x,y £ [a, b] and 
\x — y\ < -g where x < y, say, then 


| F(y)-F(x)\ = 


ry ry ry 

/ f{t)dt < / \f(t)\dt< / B dt =B(y — x) < e. 

J X J X j X 


This shows F is [uniformly] continuous on [a, b]. 
Suppose / is continuous at xq in (a, b). Observe 


m- F M = _}_r mdt 

X - Xo X- x 0 J Xo 

for x 7 ^ xq- The trick is to observe 

f(x o) = —-— / f(x 0 )dt, 

% Xo J xo 

and therefore 

F{x) ~ /(xo) - fix o) = [ x \m - f(x 0 )]dt. (i) 

X — Xo x-xo J Xo 

Let e > 0. Since / is continuous at xq, there exists 5 > 0 such that 


t £ (a, b) and \t - x 0 | < 5 imply \f(t) - f(x 0 )\ < e; 
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see Theorem 17.2. It follows from (1) that 


F(x) - Fjx q) 

X — Xq 


fix o) 


< e 


for x in (a, b ) satisfying \x — xq\ < <5; the cases x > xq and x < xq 
require separate arguments. We have just shown 


lim 

X^-XQ 


F(x) - Fjx q) 

X — Xq 


In other words, F'{x o) = f(x o). 


fix o)- 


A useful technique of integration is known as “substitution.” A 
more accurate description of the process is “change of variable.” The 
technique is the reverse of the chain rule. 

34.4 Theorem [Change of Variable]. 

Let u be a differentiable function on an open interval J such that u' 
is continuous, and let I be an open interval such that u(x) 6 I for 
all x 6 J. If f is continuous on I, then f ou is continuous on J and 

rb /*it(6) 

/ / o u(x)v!(x) dx = / f(u)du (1) 

Ja J u(a) 

for a , b in J. 

Note u{a) need not be less than u{b), even if a < b. 


Proof 

The continuity of f ou follows from Theorem 17.5. Fix c in I and let 
F(u) = f ( u f{t) dt. Then F'fu) = f(u) for all u E I by Theorem 34.3. 
Let g = F o u. By the Chain Rule 28.4, we have 

g'ix) = F'{u{x)) ■ u\x) = fiu(x)) ■ u'(x), 


so by Theorem 34.1 

f b 

/ / o u(x)v! (x) dx 



(x) dx = gib) - gia) = P(w(6)) - F(tt(a)) 





fit)dt. 


This proves (1). 
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Example 3 

Let g be a one-to-one differentiable function on an open interval I. 
Then J = g{I) is an open interval, and the inverse function g^ 1 is 
differentiable on J by Theorem 29.9. We show 


rg( b ) 

g(x)dx+ / g~ l (u) du = b ■ g(b) — a ■ g(a) 

Jg(a) 


( 1 ) 


for a, b in I. 

We put / = g -1 and u = g in the change of variable formula to 
obtain 

rb r g(b) 


r° rg{°) 

/ 5” 1 og(x)g'(x)dx = / 5 _1 («) 

Ja Jg(a) 


du. 


Since g 1 o g(x) = x for x in I, we obtain 

ra( b ) r b 

/ g~ 1 (u)du= / xg'[x)dx. 

J g(a) Ja 

Now integrate by parts with u(x) = x and v{x) = g(x): 

rg(b) rb 

/ 5 (u) du = b ■ g(b) - a- g(a) - g{x)dx. 

J g(a) Ja 

This is formula (1). 


□ 


Exercises 

34.1 Use Theorem 34.3 to prove Theorem 34.1 for the case g' is continuous. 

Hint: Let F(x) = g'\ then F' = g'. Apply Corollary 29.5. 

34.2 Calculate 

(a) lim^o \ /J e‘ 2 dt (b) lim^^ 0 ^ e ^ dt. 

34.3 Let / be defined as follows: /(f) = 0 for f < 0; /(f) = f for 0 < f < 1; 
fit) = 4 for f > 1. 

(a) Determine the function F{x) = f ' : f{t) dt. 

(b) Sketch F. Where is F continuous? 

(c) Where is F differentiable? Calculate F' at the points of 
differentiability. 
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34.4 Repeat Exercise 34.3 for / where f(t) = t for t < 0; /(f) = t 2 + 1 for 
0<f <2; f(t) = 0 for t > 2. 

34.5 Let / be a continuous function on R and define 

rx+1 

F(x) = / /(f) dt for x £ R. 

J X—l 


Show F is differentiable on R and compute F'. 

34.6 Let / be a continuous function on R and define 


34.7 

34.8 


p sin x 

G(x) = / /(f) dt for x £ R. 

Jo 


Show G is differentiable on R and compute G'. 

Use change of variables to integrate f Q x\/\ — x 2 dx. 
(a) Use integration by parts to evaluate 

/ xa.rcta.nxdx. 


Hint : Let u(x) = arctanx, so that u'(x) = yryT- 

(b) If you used v(x) = \ in part (a), do the computation again 
with v(x) = x . This interesting example is taken from J.L. 
Borman [10]. 

34.9 Use Example 3 to show arcsinxdx = ^ ^ — 1. 

34.10 Let g be a strictly increasing continuous function mapping [0,1] onto 
[0,1]. Give ageometric argument showing f Q g(x)dx+J Q g~ 1 {u)du = 1. 

34.11 Suppose / is a continuous function on [a, 6]. Show that if J ^ f(x) 2 dx 
= 0, then f(x) = 0 for all x in [a, b). Hint: See Theorem 33.4. 

34.12 Show that if / is a continuous real-valued function on [a, b\ satisfying 
J b f(x)g(x) dx = 0 for every continuous function g on [a, b], then 
f{x) = 0 for all x in [a, b ]. 
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§35 * Riemann-Stieltjes Integrals 

In this long section we introduce a useful generalization of the Rie- 
mann integral. In the Riemann integral, all intervals of the same 
length are given the same weight. For example, in our definition of 
upper sums 

n 

u(f, P) = J2 - t k - 1 ), (*) 

k= 1 

the factors (tk — tk— i) are the lengths of the intervals involved. In 
applications such as probability and statistics, it is desirable to mod¬ 
ify the definition so as to weight the intervals according to some 
increasing function F. In other words, the idea is to replace the fac¬ 
tors (tk — tk- 1 ) in (*) by [F(tk) — F(tk~i)]- The Riemann integral is, 
then, the special case where F(t) = t for all t. 

It is also desirable to allow some points to have positive weight. 
This corresponds to the situation where F has jumps, i.e., where 
the left-hand and right-hand limits of F differ. In fact, if (ck) is a 
sequence in M, then the sums 

OO 

^2c k f(u k ) 
k=1 

can be viewed as a generalized integral for a suitable F [see Exam¬ 
ples 1 and 3 on pages 301 and 309]. In this case, F has a jump at 
each Uk- 

The traditional treatment, in all books that I am aware of, re¬ 
places the factors (tk~tk- i) in (*) by [F(tk) — F(tk- 1 )] and develops 
the theory from there, though some authors emphasize upper and 
lower sums while others stress generalized Riemann sums. In this 
section, we offer a slightly different treatment, so 

Warning. Theorems in this section do not necessarily correspond to 
theorems in other texts. 

We deviate from tradition because: 

(a) Our treatment is more general. Functions that are Riemann- 
Stieltjes integrable in the traditional sense are integrable in our 
sense [Theorem 35.20]. 
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(b) In the traditional theory, if / and F have a common discontinu¬ 
ity, then / is not integrable using F. Such unfortunate results 
disappear in our approach. We will show piecewise continu¬ 
ous and piecewise monotonic functions are always integrable 
using F [Theorem 35.17]. We also will observe that if F is a 
step function, then all bounded functions are integrable; see 
Example 1. 

(c) We will give a definition involving Riemann-Stieltjes sums that 
is equivalent to our definition involving upper and lower sums 
[Theorem 35.25]. The corresponding standard definitions are 
not equivalent. 

As just explained, our development of Riemann-Stieltjes integrals 
has several positive features. However, this section is long with lots of 
technical details. Therefore, we recommend readers omit the proofs 
on first reading, and then decide whether to go through the details. 

Many of the results in this section are straightforward general¬ 
izations of results in §§32 and 33. Accordingly, many proofs will be 
brief or omitted. 

35.1 Notation. 

We assume throughout this section that F is an increasing function 
on a closed interval [a, b\. To avoid trivialities we assume F(a) < 
F(b). All left-hand and right-hand limits exist; see Definition 20.3 
and Exercise 35.1. We use the notation 

F(t~ ) = lim F(x) and F(t + ) = lim F(x). 

i->i _ x—tt+ 

For the endpoints we decree 

F(a~) = F(a) and F(b + ) = F(b). 

Note that F(t~ ) < F(t + ) for all t E [a, b\. If F is continuous at t. then 
F(t~) = F(t) = F(t + ). Otherwise F(t ~) < F(t + ) and the difference 
F(t + ) — F{t~) is called the jump of F at t. The actual value of F(t) 
at jumps t will play no role in what follows. □ 

In the next definition we employ some of the notation established 
in Definition 32.1. 
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35.2 Definition. 

For a bounded function / on [a, b] and a partition P = {a = to < 
t\ < ■ ■ ■ < t n = 6 } of [a, b], we write 

n 

Mf,P) = J2 /to) • Wk) - F (tk)]- (!) 

k=0 

The upper Darboux-Stieltjes sum is 

n 

U F (f, P ) = Mf, P) + Y, M (/> (tk- 1,4)) • [F(t*) - F^)] ( 2 ) 

fc=i 

and the lower Darboux-Stieltjes sum is 

n 

L F (f,P) = Mf,P) + (**-!>**)) ' ( 3 ) 

k =1 

These definitions explicitly take into account the possible jump 
effects of F at the points f/ c , though F may have jumps at other 
points. The other terms focus on the effect of F on the open intervals 
(ffc_i,tfc). Observe 

n n 

[«,(>] = U(*‘i u U (tk—l, tk ) 

fc=0 fc=l 

represents [a, 6 ] as a disjoint union . 2 See Remarks 35.26 for a discus¬ 
sion about the choice of open intervals versus closed intervals in the 
definitions of Riemann integrals and Riemann-Stieltjes integrals. 
Note 

U F (f,P) — L F (f, P) 

U 

= J2[M{f,(t k -i,t k )) - m (f,(t k -i,t k ))][F(tf) - F (t^_ i)] ^ 

k= 1 

and 

m(f, [a, b ]) • [F(b) - F(a)] < F f (/, P) < U F (f, P) 

<M(f,[a,b])-[F(b)-F(a)}. (5) 


2 In measure theory this is an example of a measurable partition, that is to say, 

a family of measurable sets with disjoint union [a,b\. 
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In checking (5), note 


E mt) * F M + Et F «) - 

‘"= F{t +) - fs )+ mt) - Fittj] 

= F(a + ) - F(a~) + F(b + ) - F(a+) = F(6) - F(a), 


( 6 ) 


since the last sum is a telescoping sum. The upper Darboux-Stieltjes 
integral is 


C/f(/) = inf{I7p(/, P) : P is a partition of [ a,b ]} (7) 

and the lower Darboux-Stieltjes integral is 


Lp(f) = sup{Li?(/, P) : P is a partition of [a, b}}. (8) 


Theorem 35.5 below states that Lp{f ) < C/f(/). Accordingly, we 
say / is Darboux-Stieltjes integrable on [a, b] with respect to F or, 
more briefly, F-integrable on [a, b], provided Lp(f) = Up(f); in this 
case we write 



f(x)dF{x) 


L F (f) 


UfU). 


Example 1 

For each u in [a,b\, let 

J u (t ) 


for u > a, and let 


Ja(t) 


0 for t < u, 
1 for t > u, 


0 for t = a, 
1 for t > a. 


Then J u is an increasing step function with jump 1 at u. Also, every 
bounded function / on [a, b] is J^-integrable and 



/(«)• 
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y 



More generally, if u\, 112 , ■ ■ ■, u m are distinct points in [a, 5] and if 
ci, C 2 ,..., Cm are positive numbers, then 

m 

f = t: cjj Ul 

3= 1 


is an increasing step function with jumps Cj at Uj. See Fig. 35.1 for a 
special case. Every bounded function / on [a, b] is F-integrable and 



( 1 ) 


To check (1), first note the validity of (1) will not change if some 
of the Uj are not jump points so that Cj = 0. So we may assume a 
and b are in {uj : 1 < j < m}, and a = u± < 112 <■■■ < u m = b. Let 
P be the partition {a = u\ < U 2 < ■ ■ ■ < u m = b}. Then we have 
F(Uj) - F(uj) = cj for j = 1,2,... ,m and F(uj) - F(uj 1 1 ) = 0 
for j = 2,3,..., m. Therefore 

m 

u F {f, p) = L F (f, P) = Mf , P) = J2 /K) • C J 

3 = 1 
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for any bounded function / on [a,b\. From (7) and ( 8 ) in 
Definition 35.2 and L F (f) < U F (f), it follows that 

m 

U F (f) = L F (f) = J2f(uj)-cj. 

3=1 

Hence / is F-integrable and (1) holds. □ 

Example 2 

We specialize Example 1 to the case u\ = 0, U 2 = 1, 113 = 2, 14 = 3; 
ci = C 4 = g, C 2 = C 3 = |. Thus we must have a < 0 and b > 3; see 
Fig. 35.1. For any bounded function / on [a, b], we have 

j"fdF = |/( 0) + 3/(1) + |/(2) + |/(3). 


35.3 Lemma. 

Let f be a bounded function on [a,b\, and let P and Q be partitions 
of [a, b] such that P C Q. Then 

L F (f,P) < L F (f,Q) < U F (f,Q) < U F (f,P). (1) 


Proof 

We imitate the proof of Lemma 32.2 on page 273 down to, but not 
including, formula (3). In the present case, the difference L F (f , Q) — 
L F (f,P) equals 

f{u) • [F(u+) -F(u~)\ +m(/, (4-1,«)) ' [F(u~) - F(f£_ 1 )] 
+m(/, (u,4)) • [F(^) - F(u+)] 

~m(f , (4-1,4)) ■ [-F(*fc) --^Ofc-i)], 

and this is nonnegative because 

m(f, (4-1,4)) ' [F(tk)-F(t%_ 1 )] 

= rn(f, (4-1,4)) ■ [-P’(ifc) - E(w + ) + E(u+) - F(« _ ) 

+F(u-)-F(4_ 1 )} 

< m (f, («»4)) • [^(4 ) - ^4 + )] + /(«) • [^(^ + ) - F{u )] 
+m(f, (4-i,«)) • [-^00 -^(ifc-i)]- 


(3) 
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35.4 Lemma. 

If f is a bounded function on [a, b] and if P and Q are partitions of 
[a, 6], then L F (f,P) < U F (f,Q). 

Proof 

Imitates the proof of Lemma 32.3 on page 273. ■ 

35.5 Theorem. 

For every bounded function f on [a,b ], we have L F (f) < U F {f). 

Proof 

Imitates the proof of Theorem 32.4 on page 274. ■ 

35.6 Theorem. 

A bounded function f on [a,b] is F-integrable if and only if for each 
e > 0 there exists a partition P such that 

U F (f,P)-L F (f,P)<e. 

Proof 

Imitates the proof of Theorem 32.5 on page 274. ■ 

We next develop analogues of results in §33; we return later to 
generalizations of items Definition 32.6 through Theorem 32.9. We 
begin with the analogue of Theorem 33.2. The analogue of Theo¬ 
rem 33.1 is true, but its proof requires some preparation, so we defer 
it to Theorem 35.16. 

35.7 Theorem. 

Every continuous function f on [a, 6 ] is F-integrable. 

Proof 

To apply Theorem 35.6, let e > 0. Since / is uniformly continuous, 
there exists <5 > 0 such that 

x,y€[a,b] and \x-y\ < 6 imply \f(x)-f(y)\ < 6 . 

r{b)-F (a) 

Just as in the proof of Theorem 33.2, there is a partition P of [a, b] 
such that 

e 


M(/, (4-1,4)) - rn{f, (4-1,4)) < 


F(b) - F(a) 





§35. * Riemann-Stieltjes Integrals 305 


for each k. Hence by (4) of Definition 35.2 we have 

n 

u F (f,P) - LfU, P) < E f W 3 ( „) 1 f W - P (4-i)l S 

Theorem 35.6 now shows / is T-integrable. ■ 

35.8 Theorem. 

Let f and g be F-integrable functions on [a,b], and let c be a real 
number. Then 

(i) cf is F-integrable and J b (cf)dF = c J b fdF\ 

(ii) f + g is F-integrable and f b {f + g) dF = f dF + J* g dF. 

Proof 

Imitates the proof of Theorem 33.3, using Theorem 35.6 instead of 
Theorem 32.5. ■ 


35.9 Theorem. 

If f and g are F-integrable on [a,b\ and if f(x) < g{x) for x £ [a, 6], 
then j b a fdF < J b gdF. 

Proof 

Imitates the proof of Theorem 33.4(i). ■ 


35.10 Theorem. 

If f is F-integrable on [a,b\, then \ f\ is F-integrable and 



< 



I/I dF- 


Proof 

Imitates the proof of Theorem 33.5 and uses formula (4) of 
Definition 35.2. ■ 


35.11 Theorem. 

Let f be a function defined on [a,b]. If a < c < b and f is F-integrable 
on [a, c] and on [c,b], then f is F-integrable on [a, b] and 



fdF + 



f dF. 


(1) 
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Proof 

Imitates the proof of Theorem 33.6. Note that an upper or lower sum 
on [a, c] will include the term f(c)[F(c) — F(c - )] while an upper or 
lower sum on [c, b] will include the term f(c)[F(c + ) — F(c)]. ■ 

The next result clearly has no analogue in §32 or §33. 

35.12 Theorem. 

(a) Let F\ and F 2 be increasing functions on [a,b\. If f is F\- 
integrable and F 2 -integrable on [a, b] and if c > 0, then f is 
cFi-integrable, f is (F\ + F 2 )-integrable, 

f fd{cF l ) = c f fdF 1 , (1) 

J a J a 

and 

f f d{F\ + F 2 ) = f f dF\ + I' f dF 2 . (2) 

J CL J CL J CL 

(b) Let ( Fj) be a sequence of increasing functions on [a,b] such that 
F = Yl’jL 1 Fj defines an (automatically increasing) function on 
[a, b\. Thus the series converges on the entire interval [a, b], and 
F(a) and F(b) are finite. If a bounded function f on [a,b\ is 
Fj-integrable for each j, then f is F-integrable on [a,b ] and 



Proof 

From Theorem 20.4 we see 

(Fi + F 2 )(t + ) = lim [F\(x) + F 2 (x)\ = lim F 1 (x) + lim F 2 {x) 

£—>-t+ 2—H+ X—>t+ 

= F 1 (t + )+F 2 (t+) 

with similar identities for (Fi + (cFi )(t + ) and (cFi)(t~). 

Hence for any partition P of [a, b], we have 

Uf 1+ f 2 (/, P) = U Fl (/, P ) + Uf 2 (/, P) 

L Fl+Fa (f,P) = L Fl (f,P) + L F2 (f,P), 


( 4 ) 
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U cFl (/, P) = cU Fl (/, P) and L cFl (/, P) = cL Fl (/, P). It is now clear 
that / is cPi-integrable and that (1) holds. To check (2), let e > 0. 
By Theorem 35.6 and Lemma 35.3, there is a single partition P of 
[a, b\ so that both 

U Fl (/, P) - L Fl (/, P)<'- and U F2 (/, P) - Lp 2 (/, P) < |. 
Hence by (4) we have 

U Fl + F2 (f,P) ~ L Fl +F 2 (f,P) < e - 

This and Theorem 35.6 imply / is (Pi + P 2 )-integrable. The identity 
(2) follows from 


f 


f d(Fi + P 2 ) < U Fl+F 2 (f, P) < L Fl+F 2 (f, P ) + e 


= L Fl (/, P) + Lp 2 (/, P) + e < / /dPi+/ /dP 2 + e 


and the similar inequality 

rb 


/d(Pi+P 2 )> / /dPi+ / /dP 2 — e. 


Now we prove part (b). We write 5 m for 57j=i anc i f° r the 
difference (or tail sum) P — Pj- Let B be a positive 

bound for |/| on [a, b\, and consider e > 0. Select a positive integer 
mo so that 


We will show 


\T m (b) — T m (a)\ < — for m > m 0 . 
5 B 


U F (f)-L F (f)<^. 

5 


(5) 


( 6 ) 


Since e > 0 is arbitrary, this will imply U F (f) = L F (f), so that / is 
P-integrable. We will also show 


fdF - / fdS„ 


< e for m > m q. 


(7) 


Since e > 0 is arbitrary, and f dS m = Y2jLi fa f dFj by ( 2 ), this 
will confirm (3). 





308 ®' Integration 


We now prove (6). First we claim 

\UF(f,P)—Us m (f,P)\ < — for all partitions P of [a, b] and m > mo, 

o 

( 8 ) 

|L f (/, P)-L Srn {f, P)\ < — for all partitions P of [a,b] and m > mo- 

5 

(9) 

Let P = {a = to < t\ <■■■< t n = b}. Note T m = m+1 F :i is 

an increasing function on [o, b ], so using Eq. (2) in Definition 35.2 on 
page 300, the left-hand side of inequality (8) is bounded by 

n n 

- T m (t-)} +J2 B [ T m(tk) - Tm(4_ i)]. 

k= 0 fc=l 


This sum is equal to B[T m (b + ) — T m (a~)\ = B[T m (b) — T m (a)\ which, 
by (5), is less than so ( 8 ) holds. The verification of (9) is similar. 

In view of (2), / is 5 m -integrable for each m, so for each m there 
is a partition P m of [a, b] satisfying 

U Sm (f,Pm)-L Sm (f,P m )<^ (10) 

Now we apply the triangle inequality to ( 8 ) and (9) [with P = P m \ 
and ( 10 ) to obtain 


UF(f,Pm) - L F (f,P m ) for m>m 0 . (11) 

5 

This implies ( 6 ); therefore / is E-integrable. 

Now (11) and (10) imply 

U F (f,Pm)- [ fdF and U Sm (f,P m )- [ fdS m < | 


for m > mo- Applying these inequalities and ( 8 ), we obtain 


f fdF -f 


fdS„ 


< e for m > m o, 


i.e., (7) holds. 
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Example 3 

(a) Let (uj) be a sequence of distinct points in [a,b\, and let (cj) be 
a sequence of nonnegative numbers 3 such that c j < oo. Using the 
notation of Example 1 on page 301, we define 

OO 

F = X/ c j^ u r 

i =i 

Then F is an increasing function on [a, b]; note F{a) = 0 and F(b) = 
Yl'jLi c j < oo. Every bounded function / on [a, b] is F-integrable and 



(1) 


This follows from Theorem 35.12(b) with Fj = CjJ u . , since every 
bounded function is Ej-integrable for every j, as shown in Example 1. 
(b) The function F in part (a) satisfies 


m = ^2{cj : Uj < t} for t £ (a, 6], (2) 

since J Uj (t ) = 1 if and only if uj < t. Also F(a) = 0. Moreover, 

F(t ~) = : Uj < t} for t £ (a, b], (3) 


since F(t~) = lim x ^ t - ^2{cj : Uj < x}. We also have 

F(t + ) = F(t) for t € ( a,b ], (4) 

because F(b + ) = F(b) by decree, and for t £ (a, b) and x > t, we 
have 


F(x) — F(t) = : t < Uj < x}, (5) 

so that F(t + ) = lim a ._ >t + F(x) = F(t). [Details: Given e > 0, there 
is N so that Y2JLn +i c i < e - Uor x > t and x sufficiently close to t, 
the sets {uj : t < Uj < x} and {ui,..., un} are disjoint, so the sum 
in (5) is less than e.] 


3 Allowing some c/s to be 0 won’t change the value of F, of course, but allowing 
Cj’s to be 0 is sometimes convenient. 
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(c) A function F is said to be right continuous at t if F(t) = 
F(t + ). Equation (4) shows F is right continuous except possibly 
at a. By (4), (2) and (3), we have 

F(t + ) - F(t~) = : uj = t}. ( 6 ) 

Equation ( 6 ) holds for all t in [a, b], even t = a. Therefore, F is contin¬ 
uous at t unless t = Uj for some j. Finally, F is clearly discontinuous 
at each Uj unless Cj = 0. □ 

The next theorem shows F- integrals can often be calculated using 
ordinary Riemann integrals. In fact, most F- integrals encountered in 
practice are either covered by Example 3 or this theorem. 

35.13 Theorem. 

Suppose F is differentiable on [a, b] and F' is continuous on [a, b\. If 
f is continuous on [a,b], then 

f fdF= f f{x)F'{x)dx. (1) 

J a J a 

Proof 

Note fF' is Riemann integrable by Theorem 33.2, and / is F- 
integrable by Theorem 35.7. By Theorems 32.5 and 35.6, there is 
a partition P = {a = to < t\ <■■■< t n = b} such that 

U(fF',P) — L(fF',P) < ~ and U F (f,P)-L F (f,P)<^. (2) 

By the Mean Value Theorem 29.3 on page 233 applied to F on each 
interval [tk-i,tk], there exist Xk in (tk~i,tk) so that 

F(t k ) - F(t k - i) = F'(x k )(tk - t k - 1 ); 

hence 

n n 

^2f(x k ) ■ [F(t k ) - F(t k ~ i)] = ^2 f(x k )F'(x k ) • (4 - 4_i). (3) 

k =1 k =1 

Since F is continuous, it has no jumps and (3) implies 

L F (f,P) < U(fF',P) and L(fF',P)<U F {f,P). 
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FIGURE 35.2 


Now by (2) we have 

j"f dF < UfU, P)< e -+L F {f,P)< , - + U(fFP) 

<^ + ^ + L(fF', P) < e + I" f(x)F\x ) dx 

and similarly J ^ / dF > f(x)F'(x) dx — e. Since e > 0 is arbitrary, 

(1) holds. ■ 

An extension of Theorem 35.13 appears in Theorem 35.29. 


Example 4 

Let F{t) = 0 for t < 0, F(t) = t 2 for 0 < t < 2, and F(t) = t + 5 
for t > 2; see Fig. 35.2. We can write F = F\ + 3 J 2 where F\ is 
continuous and J 2 is the jump function at 2. The function F\ is 
differentiable except at t = 2; the differentiability of F\ at t = 0 is 
shown in Exercise 28.7. Let / be continuous on [—3,3], say. Clearly 
f_ 3 f dFi = 0. Since F\ agrees with the differentiable function t 2 on 
[0, 2], we can apply Theorem 35.13 to obtain 



f(x) ■ 2 x dx = 2 



xf(x)dx. 
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Similarly we have 

p3 p3 


[ fdF\ = [ f(x)-ldx = f f(x)dx. 
J 2 J 2 J 2 


Theorem 35.11 now shows 

p3 /-2 


I f dF\ = 2 / x/(x)dx + f f(x)dx , 

X-3 XO J2 

and then Theorem 35.12(a) shows 

/ 3 /*3 /*3 /*2 /*3 

fdF= f dFi + 3 / fdJ 2 = 2 / x/(x)dx + / /(x) dx + 3/(2). 

-3 i-3 J-3 JO J2 


As a specific example, if /(x) = x 3 , then 


f f dF = 2 [ x 4 dx + / x 3 dx + 3 • 8 = —— = 53.05. 
J —3 Jo J 2 20 


2 ,>3 

4 i / ™3, 


1061 


□ 


For the proof of Lemma 35.15, we will use the next theorem, 
which is interesting in its own right. 


35.14 Theorem. 

Let F be a right-continuous increasing function on [a,b]. Then we 
have F = F c + Fj, where F c is a continuous increasing function on 
[a, b], and Fj = CjJ Uj where {u\,U 2 , ■ ■ •} are the jump points of F 
and Cj is the jump at Uj, i.e., Cj = F(uJ) — F(uj) for each j. (If 
there are no jump points, then F is continuous, F = F c and Fa = 0.) 
In general, there might be finitely many or infinitely many such Uj, 
so we will not decorate the sums until we need to. 


See Examples 1 and 3 on pages 301 and 309 for the notation. The 
function F c is called the “continuous part” of F, and Fj is called the 
“discrete part” of F. 
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Proof 

Let F c = F — F d . To show F c is an increasing function, it suffices to 
show s < t implies F c (s) < F c {t ), i.e., 

s < t implies F d (t) — F d (s) < F(t) — F(s). 

By (2) in Example 3(b) on page 309, it suffices to show 

s < t implies : s < uj < t} < F(t) - F(s). (1) 

To show this, it suffices to consider a finite subset E of {uj : s < 
Uj < t}, which we write as (to < ti < ■ ■ ■ < t n } where s < to and 
t n <t. Then 

n 

El c J : u i €E ^ = < F(t + )-F(s) = F(t) — F(s) 

k =0 

by (6) in Definition 35.2 on page 300 with a = s and b = t. Since E 
is an arbitrary finite subset of {uj : s < Uj < t}, (1) holds. 

To show F c is continuous, first note that if t ^ Uj for all j. then F 
is continuous at t, and F ( i is continuous at t as shown in Example 3(c). 
So F c = F — Fd is continuous at t in this case. Otherwise, t = Uj 
for some j. Then F(uj~) — F(uj) = Cj by the definition of Cj, and 
Fd(uj-) — Fd(u~) = Cj by (6) of Example 3(b). Therefore 

F c (u+) - F c {u~) = F(uj~) - F d (u+) - F{u~) + F d {u~) 


= [F(uj~) - F(uJ)} - [. F d (v+ ) - F d (uJ )] = Cj - Cj = 0, 
so that F c is continuous at Uj, as claimed. ■ 

It is easy to check that the representation of F as F c + F d is 
unique in the following sense: If F c +F d = G c +G d where G is another 
right-continuous increasing function, then F c = G c and F d = G d . 

35.15 Lemma. 

If F is an increasing function on [a,b} and if e > 0, then there exists 
a partition 


P = {a = to < t\ <■■■< t n = b} 
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such that 

F ( t k) ~ F ( t k-i) < e f° r k = 1 . 2 , ( 1 ) 

Proof 

The conclusion (1) does not depend on the exact values of F at any of 
its jump points, though of course they satisfy F(t~) < F(t) < F(t + ). 
Hence it suffices to prove (1) after F has been redefined at its jump 
points. We choose to define F(t) = F(t + ) at all jump points, so that 
F is right continuous on [a, h\. 

Now that F is right continuous, we can apply Theorem 35.14: 
F = F c + Y.CjJuj w here F c is continuous, each Cj is positive, and 
^3 c j < oo. If F is continuous, then the sum disappears and the proof 
below can be simplified. 

Given e > 0, select N so that J2%n +i c j < f ■ Again, if there are 
only finitely many Uj’s, this part of the proof simplifies. Since F c is 
uniformly continuous on [a, b] [by Theorem 19.2 on page 143], there 
is 5 > 0 so that 

|s — t\ < 6 implies |F c (s) — F c (t)\ < (2) 

Let P = {a = to < t\ < ••• < be a partition that includes 
{u\, ..., un} and satisfies |tk ~ tk- 1 | < 5 for k = 1,2, ..., n. Let 
N oo 

F\ = T c r Ju,j and F 2 = ^ CjJ Uj , 

1=1 j=N +1 

so that F = F c + F\ + F 2 - For each k = 1,2,..., n, we have 
- F c(*t- 1) = F c(t*) - Fc(tk-1 ) < I by (2), 

mi) - mU) = 0 

because F\ is constant on the open interval an( i 

OO 

F 2 (ti)-F 2 (t+_ 1 )<F 2 (b)-F 2 (a)< J2 G < |- 

j=N+1 

Since F = F c + Fi + F 2 , summing yields F(t] 7) — F ,) < e. ■ 

35.16 Theorem. 

Every monotonic function f on [a,b] is F-integrable. 
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Proof 

We may assume / is increasing and / (a) < f(b). Since /(a) < f(x) < 
f(b ) for all x in [a,b], f is bounded on [a, b\. For e > 0 we apply 
Lemma 35.15 to obtain P = {a = to < 4 < ■ ■ ■ < t n = b} where 


F K) - < 


1(b) - f(a) 


for k = 1,2Since M(/, (4_i,4)) = f(t k ) < f(t k ) and 
m(f, ( 4 - 1 , 4 )) = f(t k - 1 ) > /(4-i), we have 


U F (f,P) - Lp(f, P) < 4) - /(4-i)] • [F(t k ) - F(t +_,)] 


k =1 


< - /(4-i)] • 

k= 1 


/(*>) - /(a) 

Since e is arbitrary, Theorem 35.6 shows / is F-integrable. 


= e. 


35.17 Theorem. 

If f is piecewise continuous, or bounded and piecewise monotonic, 
on [a,b\, then f is F-integrable. 

Proof 

Just as in the proof of Theorem 33.8, this follows from The¬ 
orems 35.7, 35.16 and 35.11, provided we have the following 
generalization of Exercise 32.7. ■ 


35.18 Proposition. 

If f is F-integrable on [a, b\ and g(x) = f{x) except for finitely many 
points, then g is F-integrable. We do not claim f^fdF = f^gdF. 

Proof 

It suffices to show g — f is F-integrable, because then the sum 
id ~ /) + / would be E-integrable by Theorem 35.8(h). Thus it 
suffices to assume g(x) = 0 except for finitely many points. Consider 
any partition P = {a = to < 4 < ■ • ■ < t n = 6} satisfying g{x) = 0 
for all x in [a, b\ \ (to, 4, ■ ■ ■, 4}- Then from Eqs. (2) and (3) in Def¬ 
inition 35.2 on page 300 we have U F {g,P ) = J F (g,P) = L F (g,P), 
so g is clearly F-integrable; see Theorem 35.6, for example. ■ 





2^0 6. Integration 


If F\ and F 2 are increasing functions with continuous deriva¬ 
tives, then Theorem 35.13 allows the formula on integration by parts 
[Theorem 34.2] to be recast as 


F\ dF 2 + / F 2 dFi = Fi( 6)F 2 (6) - Fi(a)F 2 (o). 


There is no hope to prove this in general because if F(t) = 0 for 
t < 0 and F(t) = 1 for t > 0, then 


F dF 


FdF 


-1 


i -1 


2?1 = F(1)F(1)-F(-1)F(-1). 


The generalization does hold provided the functions in the integrands 
take the middle values at each of their jumps, as we next prove. The 
result is a special case of a theorem given by Edwin Hewitt [29]. 


35.19 Theorem [Integration by Parts]. 

Suppose F\ and F 2 are increasing functions on [o, b] and define 

*1 (*) = ~ 2 [Fi(t-) + F 1 (t + )] and Ff(t) = ±[F 2 (t~) + F 2 (t + )] 
for all t G [a, b\. Then 

f F* dF 2 + [ b Ff dF\ = Fi(b)F 2 (b) - F 1 {a)F 2 (a). (1) 

J a J a 

As usual, we decree Fi(b + ) = Fi(b), Fi(a ~) = Fi(a), etc. 

Proof 

Both integrals in (1) exist in view of Theorem 35.16. For an e > 0, 
there exists a partition P = {a = to < t\ < ■ ■ ■ < t n = b} such that 

U Fl {Ff ,P) — L Fl (Ff, P) < e. 

Some algebraic manipulation [discussed in the next paragraph] shows 
U F 2 (Ff , P ) + L Fl (Ff , P) = Fi( 6)F 2 (6) - Fi(a)F 2 (a), (2) 


so that also 

U Fl {Ff , P) + L F2 (Ff , P) = Fi( 6)E 2 (6) - Fi(a)F 2 (a). (3) 
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It follows from (2) that 

J b FI dF 2 + f b F* dF\ < U F2 (F ?, P) + U Fl (F 2 *, P) 

<U F2 (F*,P) + L Fl (F*,P) + e 
= F 1 (b)F 2 {b) - F 1 (a)F 2 (a) + e, 


while (3) leads to 

fb 


[ FI dF 2 + [ F 2 * dF 1 > F x (b)F 2 (b) - Fi(a)F 2 (a) 
J a J a 


Since e is arbitrary, (1) holds. 

It remains to verify (2). Observe 


u F2 (f*, P) + L Fl ( f;,p) = E F*(t k ) ■ [f 2 (4) - F 2 {r k )] 

n 

+ ^M(F*, (tfc-r.t*)) • [F 2 (t k ) - F 2 (t+_ 1 )} 

k= 1 
n 

k—0 

n 

+ E m ( F 2*> (4-1,4)) • [^i(ifc ) - -Pi(tfe_i)] 

fc=l 

n 

= E n^k) + F ^t)} ■ [F2(4) - F 2 (t *)] 

k—0 Z 
n 

+ E F ^-[^(tfc)-F 2 (f+_ 1 )] 

/c=l 

n 

+ E + F 2(*7)] • M) - Fi(t~ k )] 

k—0 
n 

+ E F 2 (Er) ' [*!(**) - Fi{t+_ 1 )]. 

k =1 

The first and third sums add to 

n 

- Fi(t,)F 2 (t k )}, 


( 4 ) 
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while the second and fourth sums add to 

n 

E )F 2 (t~ k ) - Fi(i+_i)F 2 (i+_i)]. (5) 

fc=l 

Since the sums in (4) and (5) add to F\(b)F 2 (b) — Fi(a)F 2 (a), by 
Eq. (6) in Definition 35.2 [on page 300] applied to F 1 F 2 , the equality 
(2) holds. The preceding algebra simplifies considerably if F\ and F 2 
are continuous. ■ 

We next compare our approach to Riemann-Stieltjes integration 
to the usual approach. For a bounded function / on [a,b], the usual 
Darboux-Stieltjes integral is defined via the upper sums 

n 

M/,4) = [4-i,4]) • [4(4) - 4(4_ x )] 

fc=i 

and the lower sums 

n 

L F (f,P) = YMf, [4-1,4]) • [4(4) - 4(4_;l)]. 

k= 1 

~ ~b 

The expressions U F (f ), L F [f) and J / dF are defined in analogy to 
those in Definition 35.2 on page 300. The usual Riemann-Stieltjes 
integral is defined via the sums 

n 

S F (f,P) = ]T/(x fc )[E(4) - 4 ( 4 - 1 )], 

k=1 

where Xk is in [4-i,4], and the mesh is defined in Definition 32.6; 
compare Definition 35.24. 

The usual Riemann-Stieltjes integrability criterion implies the 
usual Darboux-Stieltjes integrability criterion; these criteria are not 
equivalent in general, but they are equivalent if F is continuous. 
See, for example, [53, §12.2], [55, Chap. 8], or [62, Chap. 6], the most 
complete treatment being in [55]. 

35.20 Theorem. 

If f is Darboux-Stieltjes integrable on [a, b] with respect to F in the 
usual sense, then f is F-integrable and the integrals agree. 
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Proof 

For any partition P, L F (f,P) equals 

n 

X m(f, [4-1,4]) • [F{tk) ~ F{tk ) + “ F (tk- 1 ) 

k =l 

+P(t+_ 1 ) - F(4-i)] 

n 

<^/(4)[ J P(4)-n^)] 

fc=l 

n 

+ X] m (fi (4-1,4)) • ) - ^(tfc-i)] 

fc=l 

n 

k=1 

The first and third sums add to 

n n—1 

X /(4M4) - )] + X - F (4)] 

/c=l /c=0 

n— 1 

= /(4M4) - *X*n)] + X - F (tk)] 

k= 1 

+/(4)[P(tf)-P(4)] 

n 

= Yf(t k )[F(t+)-F(t^} = J F (f,P). 

k= 0 

These observations and a glance at the definition of L F (f, P ) now 
show L F (f, P) < L F (f,P). Likewise we have U F (f,P) > U F (f,P), 
so 


CM/, P) - L F (f, P) < U F (f, P) - L F (f, P). (1) 


If e > 0, the usual theory [Theorem 32.5] shows there exists a parti¬ 
tion P such that U F (f , P) — L F (f, P) < e. By (1) we see that we also 
have U F {f , P) — L F (f , P) < e, so / is P-integrable by Theorem 35.6. 
To see equality of the integrals, simply observe 



dF < W, P) < L F (f, P) + e < P F (/, + e < 


fdF + e 
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and similarly 


fdF> / fdF-e. 


We will define Riemann-Stieltjes integrals using a mesh defined 
in terms of F instead of the usual mesh in Definition 32.6. 

35.21 Definition. 

The F-mesh of a partition P is 

F-mesh(P) = ma x{F(t^) — P(t^_ 1 ) : k = 1,2,..., n}. 


It is convenient to restate Lemma 35.15: 

35.22 Lemma. 

If 5 >0, there exists a partition P such that F-mesh(P) < 5. 

35.23 Theorem. 

A bounded function f on [a, b] is F-integrable if and only if for each 
e > 0 there exists 5 > 0 such that 

F-mesh(P) < 5 implies UF(f,P) — LF(f,P)<e (1) 

for all partitions P of [a, b]. 

Proof 

Suppose the e—8 condition stated in the theorem holds. If we have 
e > 0, then (1) applies to some partition P by Lemma 35.22 and 
hence Pi?(/, P) — Lp(f,P) < e. Since this remark applies to all 
e > 0, Theorem 35.6 implies / is P-integrable. 

The converse is proved just as in Theorem 32.7 with “mesh” 
replaced by“P-mesh” and references to Lemma 32.2 replaced by 
references to Lemma 35.3. ■ 

35.24 Definition. 

Let / be bounded on [a, 6], and let 

P = {a = to < ti < ■ ■ ■ < t n = b}. 
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A Riemann-Stieltjes sum of / associated with P and F is a sum of 
the form 

n 

Mf, m E - mti)] 

k= 1 

where x k is in (t k ~i,t k ) for k = 1,2,... ,n. 

The function / is Riemann-Stieltjes integrable on [a, b] if there 
exists r in R with the following property. For each e > 0 there exists 
S > 0 such that 


l-S — r| < e (1) 

for every Riemann-Stieltjes sum S of / associated with a partition 
P having F-mesh(P) < 5. We call r the Riemann-Stieltjes integral 
of / and temporarily write it as 

US I fdF. 


35.25 Theorem. 

A bounded function f on [a, b] is F-integrable if and only if it is 
Riemann-Stieltjes integrable, in which case the integrals are equal. 

Proof 

The proof that -F-integr ability implies Riemann-Stieltjes integrabil- 
ity imitates the corresponding proof in Theorem 32.9. The proof of 
the converse also imitates the corresponding proof, but a little care 
is needed, so we give it. 

Let / be a Riemann-Stieltjes integrable function, and let r be as 
in Definition 35.24. Consider e > 0, and let <5 > 0 be as provided 
in Definition 35.24. By Lemma 35.22 there exists a partition P = 
{a = to < t\ <■■■< t n = b} with F-mesh(P) < 5. For each k = 
1,2,... ,n, select x k in ( 4 - 1 , 4 ) so that f(x k ) < m(f, t k )) + e. 
The Riemann-Stieltjes sum S for this choice of x^s satisfies 

S<L F (f,P)+e[F(b)-F(a)} 

and also 


\S ~r\ < e; 
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hence Lp{f) > Lp(f,P) > r — e — e[F(b) — F(a)]. Since e > 0 
is arbitrary, it follows that Lp(f) > r and similarly Up(f) < r. 
Therefore Lp(f) = Uf(/) = r. Thus / is F-integrable and 



35.26 Remarks. 

In the definition of upper and lower Darboux sums, we used 
closed intervals [t/.- i,tfc] for Riemann integrals, in §32, and we 
used open intervals (tk~i,tk) in this section. The reason we used 
closed intervals in §32 is because that is completely standard. 
The reason we used open intervals in this section is because 
our development was motivated by the desire to have Riemann- 
Stieltjes integrals more compatible with their measure-theoretic 
generalization, Lebesgue-Stieltjes integrals, where the “measurable 
partition” 


n n 

M= U(*‘l u U (tk—h tk ) 

k =0 fc=l 

is a natural starting point. Moreover, the arguments in Examples 1 
and 3 and in Proposition 35.18 would be somewhat more complicated 
if we had used closed intervals. 

The reader may wonder whether the theories would have changed 
if we had used closed intervals in this section or open intervals in 
§32. It turns out there would be no essential changes, as we now 
explain. We do so using increasing functions F, as in this section; see 
Corollary 35.28 for the case of Riemann integrals. We write Lp(f, P) 
and Up(f, P ) for the lower and upper Darboux-Stieltjes sums using 
closed intervals [tk-ipk] instead of open intervals (tk-i,tk)- These 
will sometimes be different from the corresponding Darboux-Stieltjes 
sums defined in Definition 35.2 on page 300. But if we define 

U F {f) = infjt/ p{fiP) '■ P partitions [a, 6]} 
and we define Lp(f) similarly, we have the following fact. 
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35.27 Proposition. 

If f is bounded on [a,b], then U F{f) = Uf{I) and Lp{f) = Lp(f)- 
Thus f is integrable using closed intervals in the Darboux-Stieltjes 
definitions if and only if it is integrable using open intervals, and in 
this case the integrals are equal. 

Proof 

We prove UF(f) = Uf(/); the proof of Lp(f) = Lp(f) is similar. 
For each partition P of [a,b], it is clear that Up(f,P) < Up{f,P)- 
Therefore [//?(/) < Ufi{f) and it suffices to show 

UfU) < u F {f). ( 1 ) 

Let e > 0. There is a partition P of [a, b] such that 

U F (f,P)<U F (f)+ ( 1 . (2) 

Note (2) holds for any refinement of P by Lemma 35.3. 

As before, if there are any jumps we list them as U\,U 2 , ■ ■ ■ and 
define Cj = F{u1f) — F(uj). Since Yl c j is finite, there is an integer 
N so that Eyljv+i < f • Of course, this step is trivial if F has 
only finitely many jumps. We first refine P so that for every j < N, 
the jump Uj is equal to some t^ in P. Then if P\ and P 2 are such 
refinements of P, we have 

OO 

\Mf,Pi)-Mf,P2)\< E o < (3) 

j=N+l 

Now we further refine P as follows. Using the definitions of F(tf) 
and F(t £), we see there are points Sk and Uk for k = 0,1,..., n so 
that 


a = So = to < Uq < Si < ti < Ui < S2 < t-2 < U2 < S3 < • • • 


''' T s n — r <C t n — r u n —\ <C s n <C t n — u n — 6, 

and all F(u\ 7 ) - F(t£) and F(tf) - F(s^) are less than 
where B is a positive bound for the absolute value |/|. We estimate 
pN) for the new partition P$ consisting of all s^, U and u^. 
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Observe: 

n n 

E M (/- ^4) • TO - F (4)] < £ B • TO - TOD < 

/c=0 k =0 

n n 

£m(/, TOD ■ [^(«fc) - TO) < E s • TO) - TO] < 

fc=0 A:=0 


and £M(/, [u fc _i,s fe ]) • [-^K) - ^(4-i)] 
k= 1 
n 

< £TOTO**)) • [44l-44r)l = MTO - -MTO 
*=1 

Summing these three inequalities, we see 

TO, - TO, p # ) < TO, P) - TO, P) + f ■ 

Now we invoke (3) to conclude 

U F (f, p # ) < u F (f, P) - Mf, P ) + to, P # ) +1 < CM/, 4 + J- 

Finally, using (2), we obtain U F (f, P^) < U F (f) + e; hence 

TO)<TO,TOTOTO 

Since e is arbitrary, (1) is established. ■ 

Proposition 35.27 is true for F(t) = f, so it is true for Riemann 
integrals. However, for this important case, we use closed intervals as 
is traditional. Thus our notation U(f,P), U{f) refers to the theory 
using closed intervals, and we do not want to confuse the situation 
here by switching to U(f,P, U(f), etc. To distinguish the theory 
using open intervals, we introduce new notation U^(f, P ), U b (f), etc. 

35.28 Corollary. 

In § 32 , on the Riemann integral, the definitions of L(f,P) and 
U (/, P) for upper and lower Darboux sums could have used open 
intervals (tk-ifik) instead of closed intervals [tk-ifik]- The resulting 
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Darboux sums l}(f,P) and U^(f,P) might be different. But if we 
define 


U b (f) = inf {U b (f,P) : P partitions [a,6]} 


and we define Lf{f) similarly, then we have U^(f) = U(f) and 
Lf{f) = L(f). Thus the two approaches to Riemann integration give 
the same integrals. 


Proof 


This is Proposition 35.27 for F(t) = t: only the notation here is 


different. 


We next give a generalization of Theorem 35.13. The proof is 
somewhat complicated and uses Corollary 35.28. It was originally 
worked out by me and my colleague Theodore W. Palmer. 

35.29 Theorem. 

Suppose F is differentiable on [a, b] and F' is Riemann integrable on 
[a, b]. A bounded function f on [a,b\ is F-integrable if and only if 
fF' is Riemann integrable, in which case 



We will give the proof after Lemma 35.30 and its corollary. 
First look at Definition 35.2 on page 300. Being differentiable, F is 
continuous. So the J F terms in the definition are 0, and we have 


n 


U F (f,P) = ^M(/, (4-1,4)) • [F(tk) - T(4-i)] 


k= 1 


and 


n 


L F (f,P) = (4-1,4)) • [F(t k ) - F(4-i)]. 


k=1 


We will use these formulas in the proof of Lemma 35.30 below. We 
also use the notation U^(f), etc., from Corollary 35.28. 
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35.30 Lemma. 

Assume F is differentiable on [a,b\, F' is Riemann integrable on 
[a,b], and f is a bounded function on [a,b\. Let B be a positive bound 
for \f\. If we have U b (F',P) — L^(F',P) < e/B, then 

\U F {f,P)-U\fF',P)\<e (1) 

and 

\L F (f,P)-L\fF',P)\<e. (2) 

Proof 

Let P = {a = to < t\ < ■ ■ ■ < t n = b}. By the Mean Value 
Theorem 29.3, for each k there exists x k in (4-1,4) so that 

F{t k ) - F(t k _ i) = F'{x k ) ■ (4 - 4_i). (3) 

Now consider an arbitrary y k in (4-1,4) and observe 

n 

\F'{x k ) — F'{y k )\ ■ (4 — t k ~i) < U\F',P)-L\F',P) < - (4) 

k= 1 

since the sum is bounded by ELiD^X-^L ( 4 - 1 , t k )) 

— m{F' , (4-i,4))] • (t k — tf c _i). Applying this and (3), we obtain 

I ELi f(Vk)[F(t k ) - F(tk- 1)] - ELi fivic) ■ F'iVk) ■ {tk ~ tk- 1)| 

= I EL 1 f{yk) ■ F'{x k ) ■ {tk ~ t k - 1 ) - ELi f{yk) ■ F'{y k ) • {tk ~ tk- 1 )| 

< ELi \f{Vk)\ ■ \F'{x k ) - F'{y k )| • {t k - t k - i) 

< B ■ ELi I F'{xk) — F'{yk)\ ■ {tk — tk- 1 ) < e- 

Therefore for y k in {t k ~i,t k ), we have 

ELi f(yk)[F(t k ) - F{t k - i)]<e+ ELi f(Vk) ' F '{y k ) ■ (t k - 4- 1 ) 

< e + ELi M(fF', (4-1,4)) ' (4 - 4-i) = e + U\fFf P) 

( 5 ) 

and 

ELi f(Vk) ■ F'{y k ) • (4 - 4-i)<e+ ELi f{Vk)[F{t k ) - F(4-i)] 

< e + ELi M (f, (4-i, 4))L(4) - ^(4-i)] = e + U F {f, P). 


( 6 ) 
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Since (5) and (6) hold for arbitrary y k in (t k -i,t k ), for each k, we 
conclude 4 

n 

U F {f, P) = {t k - U t k ))-[F(t k )-F(t k - 1 )] < e + P b (/P',P). 

k= 1 

(7) 

and 

n 

U\fF',P) = Y J MUF',(tk-i,t k ))-(t k -t k - 1 )<e + U F {f,P). (8) 

k =1 

Now (1) follows from (7) and (8); (2) has a similar proof. ■ 

35.31 Corollary. 

With F and f as in Lemma 35.30, we have U F (f) = U(fF') and 
L F (f) = L(fF’). 

Proof 

Consider e > 0. Select partitions Pi and P 2 of [a, b] so that 

\U F (f,Pi)-U F {f)\<e and \U{fF') - U\fF', P 2 )| < e. 

Such a partition P 2 exists because U(fF') = U^(fF') by Corol¬ 
lary 35.28. Since F' is Riemann integrable by hypothesis, U^(F') = 
U(F') = L(F') = L}’{F'). So there exists a partition P3 so that 

U\F',P 3 )-L\F',P 3 )<e/B. 

The last three inequalities still hold if we replace Pi, P 2 , P3 by a 
common refinement P. Now by Lemma 35.30, we have 

|P F (/,P)-P b (/P',P)| <e, 

so by the triangle inequality, we have 

\U F (f) ~ U(fF')\ < 3e. 

Since e is arbitrary, U F (f) = U(fF'). Likewise L F (f) = L(fF'). ■ 


4 Some readers may appreciate more explanation. To avoid breaking the flow of 
the proofs, this will be provided after the proof of Theorem 35.29 is completed. 
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Proof of Theorem 35.29 

Suppose / is F-integrable. Then U F (f ) = L F {f). Hence U(fF') = 
L(fF') by Corollary 35.31. Thus fF' is Riemann integrable and 

I' fdF = U F (f) = U(fF') = f f(x)F'(x)dx. 

J a J a 

Now suppose fF' is Riemann integrable. Then U(fF') = L(fF '); 
hence U F (f) = L F (f). Thus / is F-integrable and 

[ b f{x)F'{x)dx = U {fF') = U F (f) = I" fdF. 

J a J a m 


How did we so quickly conclude inequalities (5) and (6) in 
Lemma 35.30? Intuitively, we knew we could select each y^ so that 
f{yk) is very close to M (/, (tk~i,tk)), which appears in the definition 
of U F (f,P ) given after the statement of Theorem 35.29. Similarly, 
we concluded inequality (6) because we could select each yk so that 
(, fF')(yk ) is very close to M(fF f , (tk-i, tk)), which appears in the 
definition of U^(fF',P). In fact, these conclusions follow from the 
following lemma. 

35.32 Lemma. 

Suppose ai,..., a n are (fixed) nonnegative numbers and Hi,..., B n 
are nonempty bounded subsets o/M. If for some constant K, we have 

n 

^ ^ Q-kbk — dF 

k= 1 

for all choices of bk in Bk, k = 1,2 ,n, then 

n 

y j « k sup B k < K. 

k= 1 

Proof 

We prove the following by induction on m = 1,2 , ,n: 

m— 1 n 

P m ■ “ a m b m < K - y a k sup B k - y a k b k , 

k= 1 k=m-\- 1 
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for all choices of b k in B k , k = m,..., n.” As always, sums an d 

'Y!k=n +1 are t a ken to be 0. Assertion P\ holds by the hypothesis of 
the lemma. Assume P m holds for some m = 1 ,n — 1. Since b m 
in B m is arbitrary, P m implies 

m— 1 n 

Q m : u a m sup B m < K - ^ a k sup B k - ^ a k b k , 

k= 1 k=m-\-1 

for all choices of b k in B k , k = m + 1,..., n,” but this is exactly 
assertion P m + 1 - By induction, all P n and Q n hold. Since Q n is the 
conclusion of the lemma, the proof is complete. ■ 

The nontrivial part of Exercise 4.14, sup A+supB < sup(A + £>), 
is a special case of Lemma 35.32 where n = 2, ai = 02 = 1, B\ = A, 
B 2 = B , and K = sup(A + B). 

Exercise 35.6 asserts fdF = lim ri _ > . 00 J ^ f n dF provided the 
sequence (f n ) of E-integrable functions converges uniformly to / on 
[i a,b ]. Moreover, all of the comments in Discussion 33.10 carry over 
to this setting. 


Exercises 

35.1 Let F be an increasing function on [a, b]. 

(a) Show lim x _> t - F(x) exists for t in (a, b\ and is equal to sup{E(x) : 
x € (a, t)}. 

(b) Show lim a ,_ >t + F(x) exists for t in [a, b) and is equal to inf{F(x) : 
x G (t,b)}. 

35.2 Calculate / Q 3 x 2 dF(x) for the function F in Example 4. 

35.3 Let F be the step function such that F(t) = n for t € [ n,n+ 1), n 
an integer. Calculate 

(a) / Q 6 xdF(x), (b) / 3 x 2 dF{x), 

( c ) Slit x 2 dF{x). 

35.4 Let F{t) = sint for 4 G [-f,|]. Calculate 

( a ) SS /2xdF ( x ) ( b ) I- 2 / 2 xdF ( x )- 
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35.5 Let /( x) = 1 for rational x and f(x) = 0 for irrational x. 

(a) Show that if F is continuous on [a, b] and F{a) < F(b ), then / 
is not F-integrable on [a, b]. 

(b) Observe / is F-integrable if F is as in Example 1 or 3. 


35.6 Let (/„) be a sequence of F-integrable functions on [a, b ], and suppose 
f n —>f uniformly on [a, b]. Show / is F-integrable and 


f dF = lim 

n—»oo 


fndF. 


35.7 Let / and g be F-integrable functions on [a, b]. Show 

(a) / 2 is F-integrable. 

(b) fg is F-integrable. 

(c) max(/, g) and min(/, g) are F-integrable. 


35.8 Let g be continuous on [a, b\ where g(x) > 0 for all x £ [a, b] and 
define F(t) = f^g(x)dx for t S [a,b]. Show that if / is continuous, 
then 



f(x)g(x)dx. 


35.9 Let / be continuous on [a, b]. 


(a) Show J^fdF = f(x)[F(b) — F(a)] for some x in [a, b\. 


(b) Show Exercise 33.14 is a special case of part (a). 


35.10 Let F(x) = f(x) = x n for x £ [a, b] and some positive odd integer n. 
Show / q 6 fdF = \[b 2n - a 2 "]. 

35.11 Here is a “change of variable” formula. Let / be F-integrable on [a, 6]. 
Let (f> be a continuous, strictly increasing function on an interval [c, d] 
such that (j)(c) = a and 0(d) = b. Define 

g{u) = /(0(u)) and G(u) = F(0(u)) for u £ [c, d]. 

Show g is G-integrable and J ^ g dG = J ^ / dF. 

35.12 Let (v,j) be an enumeration of the rationals in [a, b] and let (c.j ) be a 
sequence of positive integers such that J2 c j < 00 ■ 

(a) Show F = CjJ Uj defines a strictly increasing function on [a, b]. 

(b) At what points is F continuous? 
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§36 * Improper Integrals 

The Riemann integral in §32 has been defined only for functions that 
are bounded on a closed interval [a, b\. It is convenient to be able to 
integrate some functions that are unbounded or are defined on an 
unbounded interval. 


36.1 Definition. 

Consider an interval [a, b) where b is finite or +oo. Suppose / is a 
function on [a, b) that is integrable on each [a, d] for a < d < b, and 
suppose the limit 


lim / f (x) dx 

d^b- J a 

exists either as a finite number, Too or —oo. Then we define 

/ b rd, 

f(x) dx = linr / f(x) dx. 


(1) 


If b is finite and / is integrable on [a,b\, this definition agrees with 
that in Definition 32.1 [Exercise 36.1]. If b = Too or if / is not 
integrable on [a,b\, but the limit in (1) exists, then (1) defines an 
improper integral. 

An analogous definition applies if / is defined on (a, b] where a is 
finite or —oo and if / is integrable on each [c, b] for a < c < b. Then 
we define 


f(x)dx= linr / f{x)dx 


(2) 


whenever the limit exists. 

If / is defined on (a, b) and integrable on all closed subintervals 
[c, d], then we fix a in (a, b) and define 




f(x) dx 


(3) 


provided the integrals on the right exist and the sum is not of the 
form Too T (—oo). Here we agree oo + i = ooifL^ —oo and 
(—oo) T L = —oo if L ^ oo. It is easy [Exercise 36.2] to see this 
definition does not depend on the choice of a. 
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Whenever the improper integrals defined above exist and are 
finite, the integrals are said to converge. Otherwise they diverge to 
+oo or to —oo. 


Example 1 

Consider f{x) = ~ for x 6 (0, oo). For d > 1, we have J'f ' dx = 
log e d, so 


r °° l 

/ ~ dx = lim log e d = +oo. 

J 1 X d —^oo 

This improper integral diverges to Too. For 0 < c < 1, we have 

fc x dx = ~ lo Se c > so 

/•> 1 

/ — dx = lim [— log„ cl = +oo. 

Jo x o+ L 


Also we have 


r ° i 

/ - = +oo. 

Jo X 


□ 


Example 2 

Consider f(x) = x~ p for x 6 [l,oo) and a fixed positive number 
p ^ 1. For d > 1, 


J\~ p dx= 


It follows that 


1 1 

x p dx = -[0 — 1] = - if p > 1 

1 — p p — 1 


and 


j; 


x p dx = Too if 0 < p < 1. 


□ 


Example 3 

We have f ^ sin x dx = 1—cos d for all d. The value (1—cos d) oscillates 
between 0 and 2, as d —> oo, and therefore the limit 

r d 

lim / sin xdx does not exist. 

d ~^°° Jo 
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Thus the symbol sin x dx has no meaning and is not an improper 
integral. Similarly, f 0 ^ sin x dx and f^° sin x dx have no meaning. 
Note the limit 


r 

lim / sin x dx 

a—> oo / „ 

J —a 


clearly exists and equals 0. When such a “symmetric” limit ex¬ 
ists even though the improper integral does not, we have 

what is called a Cauchy principal value of . Thus 0 is the 
Cauchy principal value of sin xdx, but this is not an improper 
integral. □ 


It is especially valuable to extend Riemann-Stieltjes integrals to 
infinite intervals; see the discussion after Theorem 36.4 below. Let F 
be a bounded increasing function on some interval I. The function 
F can be extended to all of 1 by a simple device: if I is bounded 
below, define 


F(t) = inf{F('u) :ii£/} for t < inf /; 

if I is bounded above, define 

F(t) = sup {F(u) :u£/} for t > sup I. 

For this reason, we will henceforth assume F is an increasing function 
on all of M. We will use the notations 

F(— oo) = lim F(t) and F(oo) = lim F(t). 

t—>—oo t—> OO 

Improper Riemann-Stieltjes integrals are defined in analogy to 
improper Riemann integrals. 

36.2 Definition. 

Suppose / is T-integrable on each interval [a, b] in K. We make the 
following definitions whenever the limits exist: 
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If both limits exist and their sum does not have the form oo + (— 00 ), 
we define 



If this sum is finite, we say / is .F-integrable on R. If / is -F-integrable 
on R for F(t) = t [i.e., the integrals are Riemann integrals], we say 
/ is integrable on R. 

36.3 Theorem. 

If f is F-integrable on each interval [a,b] and if f(x) > 0 for all 
r£l, then f is F-integrable on R or else f dF = + 00 . 

Proof 

We indicate why lim^-Qc J f; ° f dF exists, and leave the case of 
Hindoo J ( j f dF to the reader. Let h(a) = J a ° f dF for a < 0, and note 
a' < a < 0 implies h{a!) > h(a). This property implies linia^-oo h(a) 
exists and 


lim h(a) = sup{h(a) : a 6 (— 00 ,0)}. 


We omit the simple argument. 


36.4 Theorem. 

Suppose —00 < F(— 00 ) < F( 00 ) < 00 . Let f be a bounded func¬ 
tion on R that is F-integrable on each interval [a, b]. Then f is 
F-integrable on R. 


Proof 


Select a constant B such that |/(x)| < B for all x 6 R. Since we 
have F(oo)—F(—oo) < 00 , constant functions are T-integrable. Since 
0 < f+B < 2 B, Theorem 36.3 shows f+B is F-integrable. It follows 
[Exercise 36.10] that / = (/ + B) + (-B) is also F-integrable. ■ 

Increasing functions F defined on R come up naturally in prob¬ 
ability and statistics. In these disciplines, F is called a distribution 
function if we also have F(— 00 ) = 0 and F( 00 ) = 1. Of course, 
the function F(t) = t that corresponds to the Riemann integral 
is not a distribution function. Here is how a distribution function 
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comes up in probability. Consider a random experiment with numer¬ 
ical outcomes; then F(t) can represent the probability the numerical 
value will be < t. Thus F will be right continuous. As a very simple 
example, suppose the experiment involves tossing three fair coins 
and counting the number of heads. The numerical values 0, 1, 2, 
and 3 will result with probabilities |, |, and |, respectively. The 
corresponding distribution function is defined in Example 2 of §35, 
page 303, and sketched in Fig. 35.1. 

Frequently a distribution function F has the form 

F(t) = f g{x)dx 
J — OO 


for an integrable function g satisfying g(x) > 0 for all x G R. Then 
g is called a density for F. Note we must have 

POO 


g{x) dx = 1. 


If g is continuous, then g(t) = F'(t) for all t by Theorem 34.3. 


Example 4 

It turns out that e~ x dx = \Jn r [Exercise 36.7] and hence 



e x2 / 2 dx = \Z2tt. 


The most important density in probability is the normal density 


g(x) = 


,-z 2 /2 




which gives rise to the normal distribution 

pt 




e~ x / 2 dx: 


see Fig. 36.1. 


□ 


Exercises 36.1-36.8 below deal only with Riemann integrals. 
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y 



FIGURE 36.1 


Exercises 


36.1 Show that if / is integrable on [a, 6] as in Definition 32.1, then 

f b 

dx= f(x) dx. 

J a 

36.2 Show the definition (3) in Definition 36.1 does not depend on the 
choice of a. 



36.3 (a) Show 


Jo 


~ p dx = 


1 ~P 


if 0 < p < 1 and 


f 

Jo 


x p dx = +oo if p > 1. 


(b) Show J 0 °° x p dx = —f-oo for all p > 0. 


36.4 Calculate 

( a ) fo lo Se x dx, (b) / 2 °° dx, 

( c ) r dx - 

36.5 Let / be a continuous function on (a, b) such that f(x) > 0 for all 
x £ (a, b); a can be — oo, b can be +oo. Show the improper integral 
f f(x) dx exists and equals 


SU P S / f( x ) dx : [c, d] C (a, b) 


36.6 Prove the following comparison tests. Let / and g be continuous func¬ 
tions on (a, b) such that 0 < f{x) < g{x) for all x in (a, b ); a can be 
— oo, b can be +oo. 
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(a) If g(x)dx < oo, then /'^ f(x) dx < oo. 

(b) If f^ /( x) dx = +oo, then f^g(x) dx = +oo. 

36.7 (a) Use Exercise 36.6 to show fff^ e~ x2 dx < oo. 

(b) Show this integral equals y/lr. Hint: Calculate the double integral 
f^oo e ~ x e ~ v dx dy using polar coordinates. 

36.8 Suppose / is continuous on (a, b) and f^ \f(x)\ dx < oo; again a can 

be —oo, b can be +oo. Show the integral f^ f{x) dx exists and is 
finite. 

36.9 Let F be the normal distribution function in Example 4. 

(a) Show that if / is continuous on R and if the improper integral 
ff° f{x)e~ x Z 2 dx exists, then the improper integral ff° f dF 
exists and 


/ OO 1 pOO 

f dF = _ / f(x)e~ x ^dx. 

sF^J- oo 


Calculate 

( b ) fF^ z 2 dF (x), 

( d ) f-oo \x\ dF ( x ), 


(c) IZ 


'' dF(x), 


( e ) fZo xdF ( x )- 


36.10 Let / and g be F-integrable functions on M. Show f+g is F-integrable 
on M and 

fOO 


/ oo poo poo 

(f + g )dF= f dF + / gdF. 

-oo J —oo J —oo 


36.11 Show that if f and q are F-integrable on M and if f(x) < q(x) for x 
in M, then/ 00 f dF < f°° gdF. 

7 J —oo J — J—oo a 

36.12 Generalize Exercise 36.6 to E-integrals on R. 

36.13 Generalize Exercise 36.8 to E-integrals on R. 

36.14 Let ( Uj) be a sequence of distinct points in R, and let ( Cj ) be a 
sequence of nonnegative numbers such that ffcj < oo. 

(a) Observe E = c jJu } is an increasing function on R. See 

Example 3 on page 309. 

(b) Show every bounded function / on R is E-integrable and 
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(c) When will F be a distribution function? 

(d) As in Exercise 35.12, if ('Uj) is an enumeration of the rationals, 
then F is strictly increasing on R. 

36.15 (a) Give an example of a sequence (/„) of integrable functions on 
R where Jf n ( x) dx = 1 for all n and yet /„ —> 0 uniformly 
on R. 


(b) Suppose F is a distribution function on R. Show that if (f n ) is a 
sequence of E-integrable functions on R and if /„—>■/ uniformly 
on R, then / is F-integrable on R and 



lim 

n—> oo 



dF. 
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CHAPTER 


§37 * A Discussion of Exponents 

and Logarithms 

In this book we have carefully developed the theory, but have been 
casual about using the familiar exponential, logarithmic and trigono¬ 
metric functions in examples and exercises. Most readers probably 
found this an acceptable approach, since they are comfortable with 
these basic functions. In this section, we indicate three ways to de¬ 
velop the exponential and logarithmic functions assuming only the 
axioms in Chap. 1 and the theoretical results in later chapters. We 
will provide proofs for the third approach. 

Recall, for x in M and a positive integer n, x n is the product of 
x by itself n times. For x ^ 0, we have the convention x° = 1. And 
for and negative integers — n where n 6 N, we define x~ n to 

be the reciprocal of x n , i.e., x~ n = (x n ) _1 . 


37.1 Piecemeal Approach. 

This approach starts with Example 2 on page 238 and Exercise 29.15 
where it is shown that x r is meaningful whenever x > 0 and r is 
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rational, i.e., r G Q. Moreover, 

if h(x)=x r , then h , (x)=rx r ~ 1 . 

The algebraic properties x r x s = x r+s and ( xy) r = x r y r can be veri- 
hed for r, s G Q and positive x and y. For any t G M and x > 0, we 
define 

x t = sup{x r : r € Q and r < tj 


and 



This defines x 1 for x > 0. It can be shown that with this definition 
x t is finite and the algebraic properties mentioned above still hold. 
Further, it can be shown that h(x) = x t is differentiable and h'(x) = 
tx l ~ } . 

Next we can consider a fixed b > 0 and the function B defined by 
B(x) = b x for x G M. The function B is differentiable and B'[x ) = 
CbB(x) for some constant q,. We elaborate on this last claim. In view 
of Exercise 28.14, we can write 


B'{x) 


jjX+h _ fox 

lim--- 

h —>0 h 


b x • lim 

/i-> o 


b h - 1 
h 


provided these limits exist. Some analysis shows that the last limit 
does exist, so 

B'{x) = CbB(x) where q, = lim \ [b h — 1], 

/i—>o h 


It turns out that q, = 1 for a certain b, known universally as e. 
Since B is one-to-one if 6 ^ 1, B has an inverse function L which 
is named L(y) = log b y- Since B is differentiable, Theorem 29.9 on 
page 237 can be applied to show L is differentiable and 


L'{y) 


l 

CbV' 


Finally, the familiar properties of log b can be established for L. □ 


When all the details are supplied, the above approach is very 
tedious. It has one, and only one, merit; it is direct without any 
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tricks. One could call it the “brute force approach.” The next two 
approaches begin with some well defined mathematical object [either 
a power series or an integral] and then work backwards to develop the 
familiar properties of exponentials and logarithms. In both instances, 
for motivation we will draw on more advanced facts we believe but 
which have not been established in this book. 


37.2 Exponential Power Series Approach. 

This approach is adopted in two of our favorite books: [16, §4.9] 
and [62, Chap. 8]. As noted in Example 1 of §31, we believe 


e 


X 


oo 


E 



though we have not proved this, since we have not even defined 
exponentials yet. In this approach, we define 


E ( x ) = E k\ x 


k =0 


(1) 


and we define e = E{ 1). The series here has radius of convergence 
Too [Example 1, §23], and E is differentiable on M [Theorem 26.5]. 
It is easy [Exercise 26.5] to show E' = E. The fundamental property 


E(x T y) = E(x)E(y) 


(2) 


can be established using only the facts observed above. Actually [62] 
uses a theorem on multiplication of absolutely convergent series, 
but [16] avoids this. Other properties of E can be quickly established. 
In particular, E is strictly increasing on M and has an inverse L. The¬ 
orem 29.9 on page 237 assures us L is differentiable and L\y ) = 
For rational r and x > 0, x r was defined in Exercise 29.15. Applying 
that exercise and the chain rule to g(x) = L(x r ) — rL(x), we find 
g'{x) = 0 for x > 0. Hence g is a constant function. Since g( 1) = 0, 
we conclude 


L(x r ) = rL(x) for reQ and x > 0. 
For b > 0 and rational r, (3) implies 

b r = E{L(b r )) = E(rL(b)). 


(3) 
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Because of this, we define 

b x = E(xL(b )) for 

The familiar properties of exponentials and their inverses [loga¬ 
rithms!] are now easy to prove. □ 

The choice between the approach just outlined and the next ap¬ 
proach, which we will present in some detail, is really a matter of 
taste and depends on the appeal of power series. One genuine ad¬ 
vantage to the exponential approach is that the series in (1) defining 
E is equally good for defining E(z) = e z for complex numbers z. 

37.3 Logarithmic Integral Approach. 

Let us attempt to solve f = f where / never vanishes; we expect 
to obtain E(x) = e x as one of the solutions. This simple differential 
equation can be written 

f 

7 = L (1) 

In view of the chain rule, if we could find L satisfying L\y) = -, 
then Eq. (1) would simplify to 

(Lo/)'= 1, 

so one of the solutions would satisfy 

Lo f(y) = y. 

In other words, one solution / of (1) would be an inverse to L where 
L'{y) = - But by the Fundamental Theorem of Calculus II [Theo¬ 
rem 34.3 on page 294], we know such a function L exists. Since we 
also expect L{ 1) = 0, we define 

L i y ) = I ~ dt for y £ (0, oo). 


We use this definition to prove the basic facts about logarithms and 
exponentials. □ 
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37.4 Theorem. 

(i) The function L is strictly increasing, continuous and differen¬ 
tiable on (0,oo). We have 

L '{y) = - for y G ( 0 , oo). 
y 

(ii) L(yz) = L(y ) + L(z) for y,z € (0, oo). 

(iii) L(£) = L(y ) - L{z) for y,z 6 (0, oo). 

(iv) limy-Kjo L(y) = +oo and lim 3/ _ > . 0 + L(y) = -oo. 

Proof 

It is trivial to show the function /(f) = t is continuous on M, so its 
reciprocal j is continuous on (0, oo) by Theorem 17.4. It is easy to 
see L is strictly increasing, and the rest of (i) follows immediately 
from Theorem 34.3. 

Assertion (ii) can be proved directly [Exercise 37.1]. Alterna¬ 
tively, fix 2 and consider g(y ) = L(yz ) — L(y) — L(z). Since g( 1) = 0, 
it suffices to show g'{y) = 0 for y E (0, oo) [Corollary 29.4]. But since 
z is fixed, we have 


To check (iii), note L(j) + L(z ) = L(j ■ z ) = L(l) = 0, so that 
L{\) = -L(z ) and 

L (-) = L (y ■ 7 ) = L{y) + L (-) = L (v ) - L (~)- 

To see (iv), first observe L( 2) > 0 and L(2 n ) = n ■ L( 2) in view 
of (ii). Thus lim^oo L(2 n ) = + 00 . Since L is increasing, it follows 
that lim^oo L(y) = + 00 . Likewise Lijf) < 0 and L{(^) n ) = n-L(^), 
so lim ?; _ > . 0 + L(y) = — 00 . ■ 


The Intermediate Value Theorem 18.2 on page 134 shows L maps 
(0, 00 ) onto M. Since L is a strictly increasing function, it has a 
continuous strictly increasing inverse [Theorem 18.4 on page 137] 
and the inverse has domain K. 
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37.5 Definition. 

We denote the function inverse to L by E. Thus 
E ( L (y))=y for y £ (0, oo) 

and 


L(E(x )) = x for iGl. 
We also define e = E( 1) so that fijdt= 1. 


37.6 Theorem. 

(i) The function E is strictly increasing, continuous and differen¬ 
tiable on R. Then 


E'{x ) = E{x) for i£l. 

(ii) E{u + v) = E(u)E{y) for u,v £ R. 

(iii) lirn^oo E(x) = +oo and lim^-co E(x) = 0. 


Proof 

All of (i) follows from Theorem 37.4 in conjunction with Theo¬ 
rem 29.9 on page 237. In particular, 


E'(x) 


1 

L'{E(x)) 


1 

i 

E(x) 


E{x). 


If u, v £ R, then u = L(y) and v = L(z ) for some y,z G (0,oo). 
Then u + v = L(yz) by (ii) of Theorem 37.4, so 


E{u + v) = E(L(yz)) = yz = E(L(y))E(L(z)) = E(u)E(v). 


Assertion (iii) follows from (iv) of Theorem 37.4 [Exercise 37.2]. ■ 


Consider b > 0 and r £ Q, say r = — where m,n £ Z and 
n > 0. It is customary to write b r for that positive number a such 
that a n = b m . By (ii) of Theorem 37.4, we have nL(a) = mL(b ); 
hence 

b r = a = E{L(a)) = E[--n 

\n 

This motivates our next definition and also shows the definition is 
compatible with the usage of fractional powers in algebra. 


L(a) ) = E [ — ■ mL(b) ) = E(rL(b)). 
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37.7 Definition. 

For b > 0 and x in M, we define 

b x = E(xL(b)). 

Since L(e) = 1, we have e x = E(x) for all 

37.8 Theorem. 

Fix b > 0. 

(i) The function B{x) = b x is continuous and differentiable onM. 

(ii) If b > 1, then B is strictly increasing; if b < 1, then B is 
strictly decreasing. 

(iii) Ifbf^l, then B maps M onto (0,oo). 

(iv) b u+v = b u b v for u, v 6 M. 

Proof 

Exercise 37.3. ■ 

If b 1, the function B has an inverse function. 

37.9 Definition. 

For b > 0 and b f 1. the inverse of B(x) = b x is written log fe . The 
domain of log 6 is ( 0 , oo) and 

log b y = x if and only if b x = y. 

Note log e y = L(y) for y > 0. 

37.10 Theorem. 

Fix b > 0, b 7 ^ 1. 

(i) The function log fe is continuous and differentiable on (0,oo). 

(ii) If b > 1, log 6 is strictly increasing ; if b < 1, log b is strictly 
decreasing. 

(iii) l°g b (yz) = log b y + log b z fory,z € ( 0 ,oo). 

( iv ) logfe(f) = log b y- log b z for y,z € ( 0 ,oo). 

Proof 

This follows from Theorem 37.4 and the identity log b y = 
[Exercise 37.4], Note L(b) is negative if b < 1. ■ 
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The function E{x) = e x has now been rigorously developed and, 
as explained in Example 1 of §31, we have 

o° 

E M = E 

k=0 

In particular, e = Yl'kLo ¥.■ Also 

37.11 Theorem. 

e=lim(l + h) 1/h = lim (\ + . 

h —>0 n—too \ n J 

Proof 

We only need to verify the first equality. Since L'{ 1) = 1 by 
Theorem 37.4(i), and since L(l) = 0, we have 

1 = lim —-——— -— = lim —L(1 + h) = lim L ((1 + h) 1 ^ h '\ . 

o h h -+o h o V ) 

Since E is continuous, we can apply Theorem 20.5 on page 158 to 
the function f(h ) = L((l + h) l / h ) to obtain 

lim(l + h) 1/h = limE(L((l + h) 1/h )) = E( 1) = e. 
h—>-0 h—>-0 V V / J 


37.12 Trigonometric Functions. 

Either approach 37.2 or 37.3 can be modihed to rigorously develop 
the trigonometric functions. They can also be developed using the 
exponential functions for complex values since 


sinx = —\e lx - e lx ], etc.; 
2 i 


see [62, Chap. 8 ]. A development of the trigonometric functions 
analogous to approach 37.3 can proceed as follows. Since we believe 


px 

arcsinx = / (1 — f 2 )” 1 / 2 dt, 

Jo 


we can define A{x) as this integral and obtain sinx from this. Then 
cosx and tanx are easy to obtain. In this development, the number 
7 r is defined to be 2 Jq(1 — t 2 ) -1 / 2 dt. □ 
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In the exercises, use results proved in Theorem 37.4 and 
subsequent theorems but not the material discussed in 37.1 and 37.2. 

Exercises 

37.1 Prove directly that 



dt for y,zG( 0, oo). 


37.2 Prove (iii) of Theorem 37.6. 

37.3 Prove Theorem 37.8. 

37.4 Consider b > 0, b ^ 1. Prove log h y = for y € (0, oo). 

37.5 Let p be any real number and define f(x) = x p for x > 0. Show / 
is differentiable and f'{x) = pa: p_1 ; compare Exercise 29.15. Hint: 
fix) = E(pL(x)). 

37.6 Show x p y p = ( xy) p for p € R. and positive x, y. 

37.7 (a) Show that if B(x) = b x , then B'(x) = (log e b)b x . 

(b) Find the derivative of log b . 

37.8 For x > 0, let f{x) = x x . Show f'{x) = [1 + log e x] ■ x x . 

37.9 (a) Show log e y < y for y > 1. 

(b) Show 

< - 7 = for y > 1. Hint: log e y = 2 log e y/y. 

y Vv 

(c) Use part (b) to prove lim^oo 4 log e y = 0. This neat little 
exercise is based on the paper [28]. 

§38 * Continuous Nowhere-Differentiable 

Functions 

The history of continuous nowhere-differentiable functions is long 
and fascinating. Examples of such functions were constructed as early 
as 1831, by Bernard Bolzano. But a version wasn’t published until 
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Karl Weierstrass did so in 1875 [69]; he had given examples in lec¬ 
tures before that and formally presented his result on July 18, 1872. 
These early examples tended to be of the form b n cos(a n 7rx) 

or J2n=i • The delay in publicizing these examples is due 

to the suspicion of mathematicians of the era that the definition of 
“function” should not be so general as to allow such monstrosities. 

Excellent brief accounts are described in William Dunham’s 
book [21, Chap. 9] and David Bressoud’s book [13, §6.4], Dun¬ 
ham asserts that Hermite, Poincare and Picard were appalled by 
Weierstrass’s “pathological example.” Bressoud has a quotation from 
Henri Poincare that refers to these abnormal functions as coun¬ 
terexamples to the “flaws in our forefathers’ reasoning... ”. There 
is also a quote of Hermite referring to the “plague of functions that 
do not have derivatives”. He had no idea how bad a plague; see 
Theorem 38.3 on page 350 and the paragraph preceding it. 

An especially thorough and detailed history can be found in 
Johan Thirn’s Master’s thesis [66]. 

Karl Stromberg [65, Example (4.8), page 174] provides an elegant 
variant of van der Waerden’s example [68], published in 1930. We 
repeat Stromberg’s example almost verbatim because we don’t see 
how to improve it. 


38.1 Van der Waerden’s Example. 

We provide an example of a continuous function on M that is nowhere 
differentiable. Let 4>(x) = |x| for |x| < 2 and extend it to be 4- 
periodic, i.e., cj)(x + 4 q) = cj)(x) for all x £ M and q €E Z. Since the 
graph of 4> has slope ±1 on intervals between even integers, we have 

I0(«) = \s~t\ (1) 

provided there is no even integer in the open interval (s,t). The 
graph of (j) is similar to that of g in Fig. 25.1 on page 204; in fact, 
4>(x) = 2g(|) for all x. 

The continuous nowhere-differentiable function / is defined by 

OO 

f{x) = ^ fn(x ) where f n (x) = 4 _n 3(4 n x). 

71=1 
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Since each f n is continuous and 4 ~ n • 2 < oo, the Weierstrass 

M-test 25.7 on page 205 and Theorem 25.5 show / is continuous 
on M. 

Fix a in M; we will show / is not differentiable at a by showing 
there is a sequence ( h k ) of nonzero numbers satisfying 

h k —» 0 and lim ————^does no t exist. (2) 
k—yoo hk 

Until Eq. (5), the integer k > 1 is fixed. There exists e k = ±1 so that 
no even integers lie between 4 k a and 4 k a + e k . From (1), we have 

10(4 k a + e k ) - (j){A k a)\ = 1. 

In fact, for n < k, there are no even integers between 4 n a and 
4 n a + 4™~ k e k , because if 4 n a <2 q < 4 n a + A n ~ k e k for some q E Z, 
multiplying through by the integer 4 fe_n would yield 4 fe a < 4 fc_ ”-2 q < 
4 k a + efc. Thus, by (1) again, 

|0(4 n a + 4 n - fc e fc ) - 0(4 n a)| = A n ~ k for 1 < n < k. (3) 

Since cj> is 4-periodic, we also have 

|0(4 n a + A n ~ k e k ) — (/>(4 n a)| = 0 for n > k. (4) 

Combining (3) and (4) with the definition of f n , we conclude 
| f n (a + 4 ~ k e k ) — f n {o )| = 4 _fe for n < k and = 0 for n > k. 
We now let h k = ^~ k e k so that 

| f n {a + h k ) — f n (a) | = 4~ fc for n < k and = 0 for n > k. 

Therefore the difference quotient, 

f(a + h k ) - f(a) = f n (a + h k ) - f n (a) 
hk ^ h k 

= E = j2(±d, < 5 ) 

n= 1 6k n= 1 

is an even integer for even k and an odd integer for odd k. Therefore 
the difference quotients in (5) cannot converge, as k —> oo. Since 
lirn/,. h k = 0, this proves (2) so that / is not differentiable at a. □ 
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38.2 Remark. 

For later use, note the function </> in the preceding proof satisfies 
sup{| 0 ( 2 /) | : y 6 M} = 2, and for any y in M we have 

| <j)(y + h) — 4>(y)\ = h for sufficiently small h> 0. (1) 

We’ve seen that constructing continuous nowhere-differentiable 
functions can be a challenge. Now we take a more abstract approach. 
In the discussion after Definition 22.6 on page 183, it is observed that 
the space C (M) of bounded continuous functions on R is a complete 
metric space using the metric 

d(f,g) = sup{| f(y) - g{y)\ : y E M} for all f,g G C(M). 

Recall from Example 7(b) on page 174 that the irrational numbers 
are much more prevalent than the rational numbers, because the set 
(Q) is of first category in the complete metric space M. Similarly, as we 
will see in the next theorem, the continuous nowhere-differentiable 
functions are more prevalent than the differentiable ones. One might 
say mathematicians of the 19th century viewed the continuous 
nowhere-differentiable functions as the “irrational functions.” 

As just noted, the next theorem shows “most” functions in C'(M) 
are nowhere differentiable. The proof uses the Baire Category Theo¬ 
rem 21.8 in the enrichment Sect. 21; see page 173. In 1931, S. Banach 
and S. Mazurkiewicz independently published this result in Studia 
Mathematica. 


38.3 Theorem. 

Let V consist of the functions f in C(M) that have a derivative at at 
least one point. Then T> is first category in C (M). 


Proof 

Consider / in T>. Then for some x in K, the derivative f'{x) exists. 
Choose m so that \x\ < m and | f'(x)\ < m. There exists 8 in (0,1) 
so that 


f(x + h)~ f(x) , 


h 


< m — \f'(x)\ for all h € (0, <5). 
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Select a positive integer n > m satisfying - < <5. Then 

ig[- n,n] and \f(x + h) — f{x)\<hn for /i G ^0, -j . (1) 

Thus / belongs to T n , which is defined to be all / in C(M) such that 
some x in R satisfies (1) above. We have just shown V C U ^f =1 F n , so 
by the Baire Category Theorem 21.8 on page 173, it suffices to show 
each J- n is closed in C*(M) and is nowhere dense in (7(M). 

To see T n is closed, consider a sequence ( f k ) in F n converging 
to / in C(M). As noted after Definition 22.6, this means f k —»• f 
uniformly on M. We will show / is in T n . For each k , there exists x k 
so that 

x k E [—n, n] and \f k (x k + h)~ f k (x k )\ < hn for h E ^0, ^ . (2) 

By the Bolzano-Weierstrass Theorem 11.5, a subsequence of (. x k ) 
converges to some x in [—n,n]; to avoid subsequence notation, we 
will assume the sequence (, x k ) itself converges to x. Since x k —> x and 
f k —> f uniformly, we have f k {x k + h ) —> f(x + h ) for each h E [0, i); 
see Exercise 24.17 on page 200. For each h in (0, ^), we take the limit 
in (2) as k —> oo to obtain (1). Hence / belongs to F n , and T n is 
closed. 

To show T n is nowhere dense, it suffices to show no ball B r (g ) = 
{/ E C(M) : d(f,g) < r} is a subset of any F n , i.e., every such ball 
contains a function in C'(M) \ T n . By the corollary to the Weierstrass 
Approximation Theorem 27.5 on page 220, there is a polynomial p 
such that sup{|f/(y) — p(y)\ : y E \—n — l,n + 1]} < |, p(—n — 1) = 
g(—n — 1) and p{n + 1) = g(n + 1). The function p on M, defined by 
p(y ) = p(y) for \y\ < n+1 and p(y) = g(y) for \y\ > n+1, is in C'(M) 
and satisfies d(g,p ) < |. We choose K > n so that it also satisfies 
K > sup{|p'(y)| : y E [— n — l,n + 1]}. Then for each x in [— n,n\, 
the Mean Value Theorem 29.3 on page 233 implies 

| p(x + h) — p(.t)| < hK for sufficiently small h> 0. (3) 

A modification if of the sawtooth function <p in van der Waerden’s 
Example 38.1 on page 348 satisfies 


sup{|V’( 2 /)| : y E M} < - 


(4) 
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and 


\if{x + h ) — if(x) | > 2itT/t for sufficiently small h> 0, (5) 

for all x in M. In fact, using Remark 38.2, it is easy to check ip(y) = 
v 4> C 2 ^ V ) works. Since d(p,g ) < |, inequality (4) shows p+if belongs 
to B r (g). From (5) and (3), we see 

I {P + VO ( x + h) — (p + -0) (x) | > hK > hn 

for each x £ [—n, n] and sufficiently small h > 0, which shows p + if) 
cannot be in J- n . ■ 


In Theorem 38.5 below, we give another interesting application 
of the Baire Category Theorem 21.8. It is due to Corominas and 
Sunyer Balaguer [17, 1954], See also Boas [9, Chap. 1, §10], Phillips 
[52, Chap. 4, §3, Theorem 18], and Donoghue [20, §1.11]. Interesting 
generalizations can be found in [17] and Krrippel [38]. There are 
relatively straightforward versions for holomorphic complex-valued 
functions; see, e.g., Burckel [14, Example 5.64], 

First, we give an easy result. Henceforth, when we refer to an 
open interval (ct, (3), we allow a = —oo and /3 = oo, so that in 
particular (a,/3) may be M. As in Sect. 31, we write for the nth 
derivative of /. 

38.4 Proposition. 

Let f be a function on an open interval ( a,/3 ), and suppose there is 
an integer n such that f^ n \x) = 0 for all x. Then f agrees with a 
polynomial on (a, (3) of degree at most n — 1. 

Proof 

This can be seen by integrating the function f^ n times. At 
each step, one obtains a polynomial of one higher degree; see 
Corollary 29.5 and Exercise 29.7. ■ 


We write C°°((a , j3)) for the space of functions / infinitely differ¬ 
entiable on ( a,/3 ), i.e., all the derivatives /^ exist on (ct,/3). Here 
we agree /= /. 
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38.5 Theorem. 

Suppose f is in C°°((a,/3)), and suppose for each x in ( a,/3 ), there 
is an integer n x (depending on x ) such that f^ nx \x) = 0. Then f is 
a polynomial on (a.,/3 ). 

We begin with a lemma. 

38.6 Lemma. 

Suppose xq is in M, p and q are polynomials, and f is a C°° function 
defined on an interval containing xq that agrees with p on an interval 
(xo — h, xo] and agrees with q on an interval [xq, xq + h). Then p = q. 

Proof 

Assume p ^ q, and let m be the degree of the polynomial p — q. 
Then (p — q)( m \x o) ^ 0, contradicting p( m \x o) = f <yW \x o) = 
q {m \x 0 ). ■ 


Proof of Theorem 38.5 

It suffices to show that / agrees with a polynomial on every closed 
subinterval [c,d] of (a,/3). To see this is sufficient, consider a de¬ 
creasing sequence (c n ) with limit a and an increasing sequence ( d n ) 
with limit f3, where c\ < d\. For each n, let p n be a polynomial that 
agrees with / on [c n ,d n ]. Then each p n agrees with p\ on [ci,di]. 
Hence p n = p\ for all n. 1 It follows that / = p\ on ( a , /3). 

Step 1. In this step, we show that every nondegenerate closed 
subinterval 2 I of [c, d] contains an open subinterval J on which / is a 
polynomial. For each k > 0, we let = {x G I : f^ k \x) = 0}. Then, 
by hypothesis I = Ufc>o an d by the continuity of the function / 
and all of its derivatives, each E & is closed. By the Baire Category 
Theorem 21.8 on page 173, for some index n, E n has nonempty 
interior. Thus, for such an index, there is an open subinterval J C E n 
of I such that / W(x) = 0 for all x G J. By Proposition 38.4, / agrees 
with a polynomial on J, as claimed. 


1 Polynomials that agree on an infinite set are equal; otherwise their difference 
would be a nonzero polynomial with infinitely many zeros. 

2 Nondegenerate here means that its endpoints are not equal. 
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Step 2. In this step, we identify maximal nondegenerate closed 
subintervals of [c, d] on which the restriction of / is a polynomial. For 
any polynomial p that agrees with / on an open interval containing 
a point xo in [c, d], let 

a p (x o) = inf{x <E [c, x 0 \ : f = p on [x, x 0 ]} 

and 

b p (x 0 ) = sup{x e [x 0 , d\ : f = p on [x 0 , x]}. 

Let I p (x o) = [a p (xo), 6 p (xo)], and note a p (x o) < b p (x o) and I p (xo) C 
[c, d\. Then 

(a) I p (x o) is the maximal closed subinterval of [c, d] containing xo 
on which / agrees with p; 

(b) (op(xo), bp(xo)) is the maximal open subinterval of [c, d] 
containing xo on which / agrees with p; 

(c) The closed intervals J p (xo) are either disjoint or identical. 

To check assertion (c), assume I po (xo) n/ pi (xi) 7 ^ 0 , where xo < xi. 
Clearly a pi (xi) < b po (x 0 ). If b p 0 (xo) = a pi (xi), then / agrees with po 
to the left of this value, and / agrees with pi to the right of this value. 
But then Lemma 38.6 shows po = Pi, so the closed intervals involved 
aren’t maximal. Therefore a Pl (x 1 ) < b Po (x 0 ), and the polynomials pi 
and po agree on the open interval (a pi (xi), b po (x 0 )). Hence po = pi- 
Now / agrees with po = pi on the closed interval [a po (xo), 6 pi (xi)], 
so by maximality, 

[a Po (x 0 ),b Pl (x 1 )\ = [a Po (xo), 6 p 0 (x 0 )] = [a Pl (x i), 6 Pl (xi)]. 

Therefore / po (x 0 ) = [a po (x 0 ), 6 po (x 0 )] = [a pi (xi), b pi (xi)] = / pi (xi), 
and (c) holds. 

^ep 3. Our goal is to show all the closed intervals in Step 2 are the 
same, i.e., all equal [c, d], which would prove the theorem. Assume, on 
the contrary, that there exist xi, X 2 in [c, d] and polynomials pi,P 2 so 
that J pi (x 1 ) 7 ^ I P2 {x 2 ). We assume xi < X 2 . Then b pi (xi) < a P2 (x 2 ) 
and we will focus on [ 6 pl (xi),a P 2 (x 2 )], which we will write as [b, a], 
so 

Ipi{x\) 7 ^ I p2 {x 2 ) and [&,a,] = [ 6 pi (xi),a P2 (* 2 )]. ( 1 ) 

Consider the nondegenerate closed intervals from Step 2 that are 
subintervals of ( 6 , a). Since these intervals are disjoint, there are only 
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countably many of them. Moreover, there cannot be finitely many of 
them, because if there were, there would be an open interval in ( b , a) 
that is disjoint from the finite union of them. By Step 1, there would 
be another closed interval as described in Step 2, a contradiction. 

We relabel the countably infinite disjoint family of maximal open 
intervals in Step 2, that are subsets of (b, a), by ( ak,bk ). Observe 
U k( a k,bk) is dense in [b, a]; otherwise there is a nonempty open in¬ 
terval in [b, a] \ U fc ( a fcj and by applying Step 1 we could expand 
our family. Let K = [b, a] \ Ufc( a fc> which is clearly closed. Let E 
be the set of endpoints of the intervals [b, a] and all (a^, 6fc). Observe 
that E C K. Note that, by (1), b and a are right and left endpoints, 
respectively, of maximal open intervals. 

Step 4. In this step, we show that K is a perfect set, as defined 
in Discussion 21.10 on page 174, i.e., every point x in K is the limit 
of a sequence of points in K \ {x}. Otherwise, for some x in K and 
h > 0 we have K 0 (x — h, x + h) = {x}. The point x cannot be 

both a left and a right endpoint in E, so we may assume, say, that 

x is not a left endpoint in E. Then and we may suppose that 

(x,x + h) C (6, a). Since (x,x + h) intersects the dense set (J fc [ a fc>M, 
we have (x, x + h) 0 [a*,, bk\ ^ 0 for some k. Then < x + h and 
x < 6^. Since x ^ a &, x is not in {a*,} U ( ak,bk ) = [a*,, b^). Since 

x < bk, we have x < < x + h and belongs to (x, x + h). Thus 

cik € K fl (x,x + h ), a contradiction. Thus K is perfect. 

Step 5. In this step, we obtain a contradiction to our hypotheses 
by showing there is xo 6 K satisfying f^ n \x o) ^ 0 for all n > 0. 
This will prove the theorem. 

Claim 1. Let J be an open interval in [b, a] satisfying JD/\ ^ 0, 
and consider an integer n > 0. Then exists an x 6 J (~l K such that 
/W(x) ^ 0. 

Assume that J is as specified, but that no satisfies /^ n °^(x) = 0 
for all x £ J fl K. We show by induction 

/dd(x) = 0 for n > no and all x S J (1 If. (2) 

Suppose (2) holds for some n > no, and consider x £ Jn K. Since K 
is perfect, there is a sequence (x^) in K \ {x} such that lim^ x^ = x. 
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Since J is open, we may suppose that all x k are also in J. Hence 


f( n+1 \x) = lim 
k —^oo 


&\x k )~ /(»>(s) 

X k - X 


0-0 

lim -= 0 ; 

k—too X k — X 


i.e., (2) holds for n+ 1. By induction, we conclude that (2) holds as 
stated. 

On the other hand, if x E J \ K then x belongs to one of the 
maximal open intervals ( a k ,bk ). Since J 0 K ^ 0 , there exists y in 
J \ ( a k ,bk ), so that y < a k or y > b k , say y > b k . Since x < b k 
and J is an interval, J also contains b k . Thus b k belongs to J 0 K. 
Let pk be the polynomial that agrees with / on ( a k ,b k )■ Since x 
is in ( a k ,bk ), we have f^\x) = p^\x) for all j > 0. If p k is the 
zero polynomial, then clearly f( n °\x) = p^°\x) = 0. Otherwise, let 
rik be the degree of the polynomial p k , so that p( nk > is the nonzero 
constant function p^ nk \bk)- Since b k is in J 0 K , (2) implies that 
n k < no and f( n °\x) = p( n °\x) = 0. Summarizing, f( n °\x) = 0 for 
all x in the open interval J, so / agrees with a polynomial on J by 
Proposition 38.4 and J C \J k (ak, b k ), contradicting JnK ^ 0. This 
proves Claim 1. 

Since each is continuous, Claim 1 implies: 


Claim 2. If n > 0 and J is an open interval in [b, a] satisfying 
JnK ^ 0 , then there is an open interval J' so that J’ C J, J 'nK 7 ^ 
0 and f^(x) ^ 0 for all x 6 J' fl K. 3 

Applying Claim 2 to J = ( 6 , a), we obtain an open interval Jo so 
that Jo n K 0 and f(x) 7 ^ 0 for x € Jo C K. Repeated use of the 
claim yields a sequence (J n ) of open intervals so that 

Jo 2 Ji 2 Ji 2 J 2 2 J 2 2 ■ ■ ■, (3) 

each J n nK 7 ^ 0 and f( n \x) 7 ^ 0 for all x € J n 0K. Since P| n J n C\K = 
D ra JnCK 7 ^ 0, by Theorem 13.10 there is xo in K that belongs to all 
the intervals J n . Therefore f^ n \x 0 ) 7 ^ 0 for all n > 0; this completes 
Step 5 and the proof of the theorem. ■ 


3 The notation J' represents the closure of the interval J'. 
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38.7 Corollary. 

Suppose —oo < a < (3 < oo. If f is continuous on [a, /3\, and if f 
satisfies the hypotheses of Theorem 38.5 on (a, (3), then f agrees with 
a polynomial on [a, f3\. 

Even though continuous nowhere-differentiable functions are 
plentiful, by Theorem 38.3, the next theorem shows every continuous 
function on M is arbitrarily close to nice functions. 

38.8 Theorem. 

Given a continuous function f on M (bounded or not ) and e > 0, 
there is a piecewise linear function 4 g and a function if in C 00 ^) 
such that sup{|/(x) — g{x)\ : x G M} < e and sup{|/(x) — fi{x)\ : x G 
M} < e. 

Proof 

If you look at pictures of a couple of continuous functions /, as well 
as f + e and / —e, as in Fig. 24.1 on page 195, you might conclude the 
existence of such a piecewise linear function is obvious. The only flaw 
in this thinking is that, as we know, general continuous functions can 
be quite complicated, and impossible to graph. For this reason, we 
include a proof. 

Step 1. If / is continuous on [a, b] and e > 0, then there is a 
piecewise linear function g on [a, b] satisfying sup{|/(x) — g(x)\ : x G 
[a, &]} < e. To see this, we use uniform continuity of / to obtain 5 > 0 
so that 

|s — t| < 5, s,t€[a,b] implies \f(s) - f(t)\ < |. 

Select a partition {a = to < t\ < ■ ■ ■ < t n = 6} of [a, b] with 
mesh < S. For each k = l,2,...,n, let Ik be the linear function 
satisfying 4(4-i) = /(4-i) and 4(4) = /(4)- We write m k for 
min{/(4-i), /(4)} and M k for max{/(4_i), /(4)}. Then for x in 
[4_i,4], we have 

m k - | < f(x) < M k + - and 


4 A piecewise linear function on an interval is a continuous function that is linear 
on subintervals. 
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Thus f(x) lies between rri^ — | and rrik + y. The same is true for 
£k(x), and therefore 

\f(x) - £k(x)\ < e for x€[t k -i,tk\. 

The function g on [a,b], defined by g(x) = £k(x) for x in [tk-i,tk], 
satisfies sup{|/(x) — g(x)\ : x G [a, b]} < e. 

Step 2. Let £ be a linear function on an interval [a, b\. There is 
a monotonic function i/j in C'°°(M) so that ip(a) = 1(a), ip(b) = £(b), 
all derivatives of if) at a and b are 0, and 

| ij)(x) — £(x)\ < | ((b) — t(a) | for all x G [a, b\. (1) 

We begin with the function h = h* a b in Exercise 31.4 on page 267. 
Then h(x) = 0 for x < a, h(x) = 1 for x > b, h is increasing on [a, b ], 
and all its derivative are 0 at a and at b. In fact, 

h(x ) = _ K X ~ a ) _ 

f(x-a) + f(b-x) 

where / is the function in Example 3 and Fig. 31.1 on page 257. From 
the quotient rule, and writing D for the denominator obtained using 
the quotient rule, we see 

h'(x) = [f(b - x)f'(x -a) + f(x - a)f(b - x)\/D(x). 

This is nonnegative, so h is increasing. By looking at the right- 
hand derivatives of h at a, and the left-hand derivatives at b , we 
see h^ n \a) = h^ n \b) = 0 for all n in N. 5 Let 

ip(x) = £(a) + [1(b) — 1(a)} ■ h(x) for x G [a, b\. 

Condition (1) holds because, for x in [a, 6], both tp(x) and l(x) lie 
between £(a) and £(b). 

Step 3. Given a piecewise linear function g on [a, b] and e > 0, 
there is a function i/j in C°°(M) so that ip(a) = g(a), ip(b) = g(b), all 
derivatives of ^ at a and b are 0, and 

sup{|^(a;) - g(x) | : x G [a, 6]} < e. (2) 


5 Regarding why h, the quotient of two infinitely differentiable functions, also is 
infinitely differentiable, see Exercise 38.6. 
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As in Step 1, there is a partition {a = to < t\ < ■ ■ ■ < t n = b} of 
[a, b] such that |c/(4) — g(4-i)| < e and such that g agrees on each 
[4-1,4] with a linear function 4, k = 1,2,... ,n. Apply Step 2 to 
each [tk~i,tk] to obtain a function ipk in C IOO (M) so that ipkifk- 1 ) = 
4(4- 1 ) = <7(4-l) and similarly i4(4) = <7(4), all derivatives at 
4-i and 4 are 0, and 

\ipk(x) ~ g{x )| < |4(4) ~4(4-i)| < e for all x € [4-1,4]- 

The desired t/> is dehned by ip(x) = ipk(x ) for x E [4-1,4], k = 

1,2 ,...,n. 

5tep 4. Consider a continuous function / on M and e > 0. By 
Step 1, for each k in Z, there is a piecewise linear function on the 
interval [A;, k + 1] satisfying 

sup{| g k {x) - f{x) | : x E [k, k + 1]} < (3) 

We apply Step 3 to each interval [k, k + 1] to obtain tp^ in C'°°(M) so 
that ipk(k) = f(k ), ipk(k + 1) = f(k + 1), all derivatives of ipk are 0 
at k and k + 1, and 

sup{|i/> fc (x) - 9k{x)\ : x E [k, k + 1]} < (4) 

We obtain ip in by defining ip{x) = ipk(x) for x in [k, k + 1], 

k E Z. From (3) and (4) we conclude 

sup{|^(x) - f(x )| : x f 1} < y < f. 

•j ■ 


38.9 Corollary. 

The space of all bounded piecewise linear functions and the space 
C°°(M)nC(M) of all bounded infinitely differentiable functions on M 
are dense in C(M), using the distance d(f,g) = sup{|/(y) — g(y)\ : 
y E M} defined prior to Theorem 38.3. 

The next result is both a corollary to Theorem 38.8 and a lemma 
for the next result. 

38.10 Lemma. 

Consider continuous f on [a,b], e > 0, and a constant c > 0. 
Then there is a piecewise linear function g on [a, b] such that 
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sup{|/(s) — g(x) | : x G [a, 6]} < e and the absolute value of the 
slope of each of its linear segments exceeds c. 

Proof 

Before continuing, you might wish to reread the first paragraph of 
the proof of Theorem 38.8. Since, by that theorem, it now suffices to 
consider the case when / itself is a linear function £, it will be easy 
to see why this lemma is true. 

It suffices to consider the case when £ is increasing, and we may 
assume c exceeds the slope of i. There is a 8 > 0 sufficiently small 
that one can replace any line segment from {x, £(x)) to {x+8, £(x+5)) 
by two line segments, one rising from (x,£(x)), with slope exceeding 
c, to the line £ + |, and the other dropping down to (x + 5, f(x + 5)), 
at a slope less than —c. By replacing 6 by a smaller 5, if necessary, 
we may assume 5 divides b — a. Then there is partition {to = a < 
t\ < ■ ■ ■ < t n = b} of [a, b\, with tk = ifc-i + <5 for each k, so that each 
line segment from (tk-i,£(tk-i)) to (tk,£(tk)) can be replaced by 
two line segments each with slope exceeding c in absolute value. The 
resulting piecewise linear function 6 g on [a, b] is continuous because 
it agrees with / = £ at each tk, and it satisfies 

sup{b(x) - /(x)| : x G [a, b]} = | < e. 

This establishes the lemma. ■ 

We now return to continuous nowhere-differentiable functions. 
So far as we know, until 1992 the construction of such functions 
has involved summing certain continuous functions, i.e., building 
them up from simpler functions. The next construction, due to Mark 
Lynch [44] in 1992, is quite different, using some topology and no infi¬ 
nite series. Lynch starts with certain subsets of the plane and shrinks 
them down to the graph of a continuous nowhere-differentiable func¬ 
tion. He uses Example 6 on page 171, which states that a function 
on a compact subset of M is continuous if and only if its graph is 
compact. Later Lynch [45] generalized his technique to construct 
continuous functions that are differentiable only at the rationals. 


6 It is tempting to call this a “stegosaurus linear function.” 
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Below, we simplify the technique in [45] just to obtain a continuous 
nowhere-differentiable function. 


38.11 Mark Lynch’s Construction. 

Step 1. Let £ be a linear function on an interval [a, b\. Then its graph 
L is a line segment in the plane. We assume the slope of £ exceeds 2 n 
in absolute value. We will construct a (closed) rhomboid' R about 
L with the following property: 


Property R n : If / is a function on [a, b] and if the graph of 

/ is contained in R, then for each x G [a, b] there is y G [a, b] 

such that x ^ y and I I > n ■ 

y x 

First, we suppose the slope exceeds 2 n. Let m = be the midpoint 
of the interval [a, b]. Then we have 

£{b) — £{m) £{m) — £{a) 


— a 


b — a 


> n\ 


thus there exists e > 0 so that 
£{b) — e — \£{m) + e] 


> n and 


£{m) — e — \£{a) + e] 


> n. (1) 


b — a b — a 

The desired rhomboid R is bounded above and below by the graphs 
of £ + e and £ — e, and bounded on the left and right by the vertical 
line segments connecting (x, £(x) — e) and (x, £(x) + e) for x = a and 
for x = b. Consider x in [a, b\. If x < m, then using (1) we obtain 

f{b) - f{x) £{b) - e - [1(a) + e] £{b) - e - [£(m) + e] 

b — x ~ b — a ~ b — a ’ 

so Property R n holds with y = b. If x > m, then 


f{x) - /(a) ^ £{x) - e - [£{a) + e] ^ £{m) - e - [£{a) + e] ^ __ 


x — a 0 — a 

and Property R n holds with y = a. 


b — a 


Now suppose the slope of £ is less than —2 n. Then use — £ to 
obtain a rhomboid R' satisfying Property R n . Let R = —R'. If the 


7 For us, a rhomboid is a parallelogram with unequal adjacent angles. 
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Solid nonvertical lines 
Line H has slope >2. have slope > 4 or <-4 



FIGURE 38.1 


graph of / is contained in R, then the graph of —/ is contained in 
R 1 , and Property R n holds for — / and R’. So it holds for / and R. 

Step 2. Now we construct a continuous nowhere-differentiable 
function on [0,1]. We begin with a piecewise linear function g\ on 
[0,1] such that the absolute value of the slope of each segment ex¬ 
ceeds 2. Note g\ can be selected to be linear on [a, b], as illustrated 
in Fig. 38.1, and observe the x and y axes are not drawn to scale. 
Let C\ be the union of rhomboids surrounding the line segments of 
g i, where each rhomboid satisfies Property R n for n = 1. Then C\ 
satisfies the following property for n = 1. 


Property n: If / is a function on [0,1] and if the graph of / 
is contained in C n , then for each x 6 [0,1] there is y G [0,1] 
such that 0 < \y — x\ < ^ and 


f{y)-f{x) 

y-x 


> n. 


For the inductive construction, suppose we have C \,..., C n -\ sat¬ 
isfying C n -1 C ••• C C\, where each Ck is a union of rhomboids 
satisfying Property k. By Lemma 38.10, there is a piecewise linear 
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function g n on [0,1] whose graph lies in the interior of C n -± such 
that the absolute value of the slope of each segment exceeds 2 n. By 
breaking segments of g n into smaller segments, if necessary, we may 
assume their domains, i.e., their projections onto the x-axis, each 
have length < -. By Step 1 , each such segment of g n is included in 
a rhomboid satisfying Property R n , with the additional conclusion 
0 < \y — x\ < Therefore C n satisfies Property n. Moreover, since 
the graph of g n lies in the interior of C n _ i, the construction in Step 1 
shows (using a smaller e if necessary) we can select the rhomboids 
so that their union C n is a subset of C n -\ and so that the vertical 
line segments in C n have length < ^. 

Now let C = r\™ =l C n . Each set C n is a closed and bounded 
set in the plane, hence compact. By Theorem 13.10 on page 89, C 
is compact and nonempty. Also, for each x in [0,1], the sets {y G 
[0,1] : (x, y) G C n } are compact and nonempty and, since the vertical 
line segments in C n have length < —, their intersection {y G [0,1] : 
(x, y) G C} has exactly one point. Thus C is the graph of a function / 
on [0,1]. Since its graph is compact, Example 6 on page 171 shows / is 
continuous. Finally, consider x in [0,1]. For each n, using Property n 

we obtain y n in [0,1] so that 0 < \y n — x\ < ^ and Z{^ > n - 
Thus / is not differentiable at x. □ 


Exercises 

38.1 Why hasn’t anyone constructed a nowhere-differentiable continuous 
function by simply finding a suitably complicated Taylor series? 

38.2 Show that if / is a function on R and /^ is a polynomial for some n, 
then / is itself a polynomial. 

38.3 Show that there is a differentiable function on R whose derivative is 
nowhere differentiable. 

38.4 If / is nowhere differentiable and g is differentiable on R, must f + g 
be nowhere differentiable? 

38.5 Consider continuous nowhere-differentiable functions / and g on R. 
(a) Must / + g be nowhere differentiable? 
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(b) Show fg need not be nowhere differentiable. Hint : Let / be a 
nowhere-differentiable function satisfying d(f, 1*) < 1, where 1* 
denotes the constant function identically equal to 1 on R. Explain 
why the reciprocal g of / is nowhere-differentiable on R. 

38.6 In Exercise 31.4 it was noted, without proof, that the sum, product, 
etc. of infinitely differentiable functions is again infinitely differen¬ 
tiable. Also, f/g is infinitely differentiable if both / and g are, and if 
g never vanishes. Verify the last claim. Hint: Show the nth derivative 
of f/g has the form h n /g 2 where h n is infinitely differentiable. 



Appendix on Set Notation 


Consider a set S. The notation igS means x is an element of 
S] we might also say “x belongs to S” or “x is in S." The notation 
x £ S signifies x is some element but x does not belong to S. By 
T C S we mean each element of T also belongs to S, i.e., x G T 
implies x G S. Thus we have 1 £ N, 17 6 N, — 3 ^ N, | ^ N, y/2 £ N, 
^ G Q, j G M, y/2 G M, y/2 ^ Q, and n G M. Also we have NCI, 
QCR, and RCR. 

Small finite sets can be listed using braces { }. For example, 
{2,3, 5, 7} is the four-element set consisting of the primes less than 
10. Sets are often described by properties of their elements via the 
notation 


{ = }• 

Before the colon the variable [n or x, for instance] is indicated and 
after the colon the properties are given. For example, 

{n : n G N and n is odd} (1) 

represents the set of positive odd integers. The colon is always read 
“such that,” so the set in (1) is read “the set of all n such that n is 
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in N and n is odd.” Likewise 

and 1 < x < 3} (2) 

represents the set of all real numbers greater than or equal to 1 and 
less than 3. In §4 this set is abbreviated [1,3). Note that 1 G [1,3) but 
3 ^ [1,3). Just to streamline notation, the expressions (1) and (2) 
may be written as 

{n E N : n is odd} and {x E K : 1 < x < 3}. 

The first set is then read “the set of all n in N such that n is odd.” 

Another way to list a set is to specify a rule for obtaining its 
elements using some other set of elements. For example, {n 2 : n E N} 
represents the set of all positive integers that are the square of other 
integers, i.e., 

(n 2 : n E N} = (m E N : m = n 2 for some n € N} = (1,4,9,16,25,...}. 

Similarly {sin j : n £ N} represents the set obtained by evaluating 
sin ™ for each positive integer n. Actually this set is finite: 



The set in (1) can also be written as{2n— 1 : n E N}. One more 
example: {a; 3 : x > 3} is the set of all cubes of all real numbers 
bigger than 3 and of course equals {y E M : y > 27}, i.e., (27, oo) in 
the notation of §5. 

For sets S and T, S\T signifies the set {x E S : x £ T}. For 
a sequence (A n ) of sets, the union U A n and intersection n A n are 
defined by 

|^J A n = {x : x E A n for at least one n}, 

P| A n = {x : x E A n for all n}. 

The empty set 0 is the set with no elements at all. Thus, for example, 
{n € N : 2 < n < 3} = 0, {r E Q : r 2 = 2} = 0, {x E M : x 2 < 
0} = 0, and [0, 2] n [5, oo) = 0. 

For functions / and g, the notation f+g, fg , fog , etc. is explained 
on page 128. 

The end of a proof is indicated by a small black box. This replaces 
the classical QED. 



Selected Hints and Answers 


Notice. These hints and answers should be consulted only after serious 
attempts have been made to solve the problems. Students who ignore this 
advice will only cheat themselves. 

Many problems can be solved in several ways. Your solution need not 
agree with that given here. Often your solution should be more elaborate. 


1.1 Hint: The following algebra is needed to verify the induction step: 


n(n + 1)(2 n + 1) 


+ (n + l) 2 = (n + 1) 


2n 2 


6 


+ n + 1 


(n + l)(n + 2)(2n + 3) 

6 ' 


1.3 Hint: Suppose the identity holds for n. Then work on the right side 
of the equation with n+1 in place of n. Since ( x+y ) 2 = x 2 +2xy+y 2 , 

(1 + 2 H-+ n + (n + 1)) = (l + 2 + ''’ + n) 2 

+2(n+!)(! + 2 + ■■■n) + (n + 1) 2 . 


Use Example 1 to show the second line has sum (n + l) 3 ; hence 
(1+2-1-b(n+l)) 2 = (1+2+- • • n) 2 +(n+l) 3 = 1 3 +2 3 H-b(n+l) 3 . 


1.5 Hint: 2 — T. + 2 n+i = 2 — jAr- 

1.7 Hint: 7 n+1 ~- 6(n + 1) - 1 = 7(7" - 6n - 1) + 36n. 
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1.9 (a) n > 5 and also n = 1. 

(b) Clearly the inequality holds for n = 5. Suppose 2 n > n 2 for 
some n > 5. Then 2 n+1 = 2 ■ 2 n > 2n 2 , so 2 n+1 > [n + l) 2 
provided 2n 2 > (n + l) 2 or n 2 > 2n + 1 for n > 5. In fact, this 
holds for n > 3, which can be verified using calculus or directly: 
n 2 > 3n = 2n + n > 2n + l. 

1.11 (a) Hint: If n 2 + 5n + 1 is even, then so is (n + l) 2 + 5(n + 1) + 1 = 
n 2 + 5n + 1 + [2n + 6]. 

(b) P n is false for all n. Moral: The basis for induction (Ii) is crucial 
for mathematical induction. 

2.1 Hint: Imitate Example 3. You should, of course, verify your asser¬ 
tions concerning nonsolutions. Note there are 16 rational candidates 
for solving x 2 — 24 = 0. 

2.3 Hint: \J2 + \[2 is a solution of x 4 — 4a: 2 + 2 = 0. 

2.5 Hint: [3 + -\/2] 2 ^ 3 is a solution of a: 6 — 22a; 3 + 49 = 0. 

2.7 (a) Show x = \J\ + 2\[3— \f3 satisfies the quadratic equation x 2 + 
2x\/3 — 1 — 2y/3 = 0. Alternatively, start with the observation 
( V / 4 + 2v / 3) 2 = 4 + 2^3 = 1 + 2\/3 + 3 = (1 + V3) 2 . 

(b) 2. 

3.1 (a) A3 and A4 hold for a £ N, but 0 and —a are not in N. Like¬ 

wise M4 holds for a £ N, but a -1 is not in N unless a = 1. 
These three properties fail for N since they implicitly require 
the numbers 0, —a and a -1 to be in the system under scrutiny, 
namely N in this case. 

(b) M4 fails in the sense discussed in (a). 

3.3 (iv) Apply (iii), DL, A2, A4, (ii) and A4 again to obtain 

(—a)(—b) + (- ab) = (-a)(-b) + (-a)b= (-a)[(-6) + b) 

= (—a)[b + (—6)] = (—a) • 0 = 0 = ab + (— ab ). 


Now by (i) we conclude (—a)(— b) = ab. 

(v) Suppose ac = be and c ^ 0. By M4 there exists c _1 such that 
c • c _1 = 1. Now (supply reasons) 

a = a -1 = a(c-c _1 ) = (ac)c _1 = (6c)c _1 = 6(c-c _1 ) = 6-1 = 6. 

(a) If |6| < a, then —a < — 16|, so —a < —16| < 6 < |6| < a. Now 
suppose —a < 6 < a. If 6 > 0, then |6| = 6 < a. If 6 < 0, then 
|6| = — 6 < a; the last inequality holds by Theorem 3.2(i) since 
—a < 6. 


3.5 
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(b) By (a), it suffices to prove —|o — b\ < |a| — |6| < \a — b\. Each 
of these inequalities follows from the triangle inequality: |6| = 
|(6— a) + a\ < |6 — a| + |a| = |a — b\ + |o| which implies the first 
inequality; |a| = \(a — b) + b\ < \a — b\ + |6| which implies the 
second inequality. 

3.7 (a) Imitate the answer to Exercise 3.5(a). 

(b) By (a), |a — b\ < c if and only if — c < a — b < c, and this 
obviously holds [see 04] if and only if 6 — c<a<6 + c. 

4.1 If the set is bounded above, use any three numbers > supremum of 
the set; see the answers to Exercise 4.3. The sets in (h), (k) and (u) 
are not bounded above. Note the set in (i) is simply [0, 1]. 

4.3 (a) 1; (c) 7; (e) 1; (g) 3; (i) 1; (k) No sup; (m) 2; (o) 0; (q) 16; 
(s) |; (u) No sup; (w) In (s), note 1 is not prime. 

4.5 Proof Since sup S' is an upper bound for S, we have supS > s 
for all s £ S. Also supS £ S by assumption. Hence supS is the 
maximum of S, i.e., supS = maxS. 

4.7 (a) Suppose S C T. Since supT > t for all t £ T we obviously 

have supT > s for all s £ S. So supT is an upper bound for 
the set S. Hence supT is > the least upper bound for S, i.e., 
supT > supS. A similar argument shows inf T < inf S; give it. 
(b) Since S C S U T, supS < sup(S U T) by (a). Similarly 
supT < sup(SUT), so maxjsupS,supT} < sup(SUT). Since 
sup(S U T) is the least upper bound for S U T, we will have 
equality here provided we show: maxjsupS,supT} is an up¬ 
per bound for the set S U T. This is easy. If x £ S, then 
x < supS < maxjsupS,supT} and if x £ T, then x < 
supT < maxjsupS,supT}. That is, x < max{supS,supT} 
for all x £ S U T. 

4.9 (1) If s £ S, then — s £ —S, so — s < sq. Hence we have s > —sq 
by Theorem 3.2(i). 

(2) Suppose t < s for all s £ S. Then —t > — s for all s £ S, i.e., 
—t> x for all x £ —S. So —t is an upper bound for the set —S. 
So —t > sup(—S). That is, — t > sq and hence t < —Sq. 

4.11 Proof By 4.7 there is a rational r± such that a < r\ < b. By 4.7 
again, there is a rational r 2 such that a < < rq. We continue by 

induction: If rationals n,..., r n have been selected so that a < r n < 
r n -1 < ■ ■ ■ < V 2 < , then 4.7 applies to a < r n to yield a rational 

r n+ 1 such that a < r n+ 1 < r n . This process yields an infinite set 
{n,r 2 ,...} in Qn (a, 6). 
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Alternative Proof Assume Qfl (a, b) is finite. The set is nonempty 
by 4.7. Let c = min((Q> D (a, b)). Then a < c, so by 4.7 there is a 
rational r such that a < r < c. Then r belongs to Qfl (a, b), so c < r, 
a contradiction. 

4.13 By Exercise 3.7(b), we have (i) and (ii) equivalent. The equivalence 
of (ii) and (iii) is obvious from the definition of an open interval. 

4.15 Assume a < b + L for all n £ N but a > b. Then a — b > 0, and 
by the Archimedean property 4.6 we have no(a — b) > 1 for some 
n o £ N. Then a > b + contrary to our assumption. 


5.1 
5.3 
5.5 

5.7 

6.1 


6.3 


6.5 


7.1 


7.3 


7.5 


(a) (-oo,0); (b) (-oo,2]; (c) [0,oo); (d) (-\/8,%/8). 

Hint: The unbounded sets are in (h), (k), (1), (o), (t) and (u). 
Proof Select So £ S. Then inf S < sq < sup S whether these 
symbols represent ±oo or not. 

Use Exercise 5.4 and the fact —(A + B) = (—A) + (-B). 

If s < t, then clearly s* C t*. Conversely, assume s* C t* but 
that s > t. Then t £ s* but t 0 t*, a contradiction. 
s = t if and only if both s < t and t < s if and only if both 
s* C t* and t* C s* if and only if s* = t*. 

If r £ a and s £ 0*, then r + s < r, so r + s £ a. Hence 
a + 0* C a. Conversely, suppose r £ a. Since a has no largest 
element, there is a rational t £ a such that t < r. Then r — t is 
in 0*, so r = t + (r — t) £ a + 0*. This shows a C a + 0*. 

—a = {r £ Q : s qL a for some rational s < — r}. 

No; it corresponds to s/2. 

This is the Dedekind cut corresponding to \/2. 
l l j_ j_ j_ 

4 ’ 7 > 10 ’ 13 ’ 16 
1 2 1 4 _ _ 5 _ 

3 ’ 9 > 9 > 81 ’ 243 

(a) converges to 1; (c) converges to 0; (e) does not converge; (g) 
does not converge; (i) converges to 0; (k) does not converge; (m) 
converges to 0 [this sequence is (0,0,0,...)]; (o) converges to 0; (q) 
converges to 0 [see Exercise 9.15]; (s) converges to | 

(a) Has limit 0 since s n = l/{\Jn 2 + 1 + n ). 

(c) '/An 2 


(a) 

(b) 

(a) 


(b) 

(b) 

( c ) 
(a) 
( c ) 


+ n— 2n = n/{\/An 2 + n + 2n) and this is close to 


for large n. So limit appears to be |; 


2n+2n 


it is. 


8.1 (a) Formal Proof Let e > 0. Let N = Then n > N implies 


I (-!)"■ 
I n -0 


= i < e. 


(b) Discussion. We want n -1 / 3 < t or ) < e 3 or 1/e 3 < n. So 
for each e > 0, let N = 1/e 3 . You should write out the formal 
proof. 
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(c) Discussion. We want 1— || < e or | ( 3 ra+ 2 )- 3 l < e or 
3 ( 3 n+ 2 ) < e ° r ^ < 3n + 2 or ^ — | < n. So set N equal 



(d) Discussion. We want (n + 6)/(n 2 — 6) < e; we assume n > 2 
so that absolute values can be dropped. As in Example 3 we 
observe n + 6 < 7n and n 2 — 6 > |n 2 provided n > 3. So 
it suffices to get 7 n/(\n 2 ) < e [for n > 3] or — < n. So try 
N = max{3, ^}. 

8.3 Discussion. We want y/~s^ < e or s n < e 2 . But s n -A 0, so we can get 
s n < e 2 for large n. 

Formal Proof Let e > 0. Since e 2 > 0 and lim s n = 0, there exists 
N so that |s„ — 0| < e 2 for n > N. Thus s n < e 2 for n > N, so 
y/s^ < e for n > N. That is, \y/s^ — 0| < e for n > N. We conclude 
lim = 0. 

8.5 (a) Let e > 0. Our goal is to show s — e < s n < s + e for large 
n. Since lima„ = s, there exists N\ so that \a n — s| < e for 
n > N\. In particular, 

n> N\ implies s — e < a n . (1) 

Likewise there exists IV 2 so that \b n — s| < e for n > -/V 2 , so 

n > N 2 implies b n < s + e. (2) 

Now 

n > maxjiVi, N 2 } implies s — e < a n < s n < b n < s + e; 
hence |s — s n | < e. 

(b) It is easy to show lim(— t n ) = 0 if limt„ = 0. Now apply (a) to 
the inequalities —t n < s n < t n . 

8.7 (a) Assume limcos( I ^ L ) = a. Then there exists N such that n> N 
implies | cos(^) — o| < 1. Consider n > N and n + 3 where 
n is a multiple of 6; substituting these values in the inequality 
gives |1 — a| < 1 and | — 1 — a| < 1. By the triangle inequality 

2 = |(1 - a) - (-1 - o)| < |1 - a\ + | - 1 - a| < 1 + 1 = 2, 

a contradiction. 

(b) Assume lim(— l) n n = a. Then there exists N such that n > N 
implies |(—1 ) n n — a| < 1. For an even n > N and for n + 2 this 
tells us \n—a\ < 1 and |n+2—a| < 1. So 2 = |n+2—a— (n— a)| < 
\n + 2 — a| + \n — a| < 2, a contradiction. 
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(c) Note the sequence takes the values ± for large n. Assume 
limsin( I 7 : ) = a. Then there is N such that 


n > N implies | sin 


. / T17T \ VS 

ml — I — a < — 


V 3 7 


Substituting suitable n > N, we obtain 
By the triangle inequality 


V3 


— a 


< ^ and 


Vs = 


Vs 

2 


'—Vs' 



Vs 


< 

-Y~ a 

+ 


a — 


Vs Vs _ r 

< ~2 + T " 



a contradiction. 

8.9 (a) Hint: There exists No in N such that s n > a for n > Nq. 

Assume s = lim s n and s < a. Let e = a — s and select N > Nq 
so that |s„ — s | < e for n > N. Show s n < a for n > TV; a 
picture might help. 

9.1 (a) lim(2±i) = lim(l + i) = lim 1 + lim i = 1 + 0 = 1. The sec¬ 
ond equality is justified by Theorem 9.3 and the third equality 
follows from Theorem 9.7(a). 

(b) lim(3n + 7) / (6 n — 5) = lim(3 + 7/n)/(6 — 5/n) = lim(3 + 
7/n)/lim(6—5/n) = (Iim3+7dim(l/n))/(lim6—5dim(l/n)) = 
(3 + 7 • 0) / (6 — 5 • 0) = 7 The second equality is justified by The¬ 
orem 9.6, the third equality follows from Theorems 9.3 and 9.2, 
and the fourth equality uses Theorem 9.7(a). 

9.3 First we use Theorem 9.4 twice to obtain lima^ = liman • lima); = 
a ■ lima); = a • lima n - lima n = a ■ a • a = a 3 . By Theorems 9.3 
and 9.2, we have lim(a 3 + 4a n ) = lima 3 + 4 • lima n = a 3 + 4a. 
Similarly lim(6^ + 1) = lim b n ■ lim b n + 1 = b 2 + 1. Since b 2 + 1^0, 
Theorem 9.6 shows lim s n = ( a 3 + 4 a)/(b 2 + 1). 

9.5 Hint: Let t = limt„ and show t = (t 2 + 2)/2 1. Then show t = V%- 

9.7 It has been shown that s n < ^/2/(n — 1) for n > 2, and we need to 
prove lims n = 0. 

Discussion. Let e > 0. We want s n < e, so it suffices to get 
V%/{n — 1) < e or 2/(n - 1) < e 2 or 2e -2 + 1 < n. 

Formal Proof. Let e > 0 and let N = 2e _2 + l. Then n > N implies 
s n < VV{n~ 1) < v/2/(2e-" 2 + 1-1) = e. 
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9.9 (a) Let M > 0. Since lims n = +oo there exists N > Nq such that 
s n > M for n > N. Then clearly t n > M for n > N, since 
s n < t n for all n. This shows limt n = +oo. 

(c) Parts (a) and (b) take care of the infinite limits, so assume 
(s„) and (t n ) converge. Since t n — s n > 0 for all n > No, 
lim(t n — s n ) > 0 by Exercise 8.9(a). Hence limf n — lims n > 0 
by Theorems 9.3 and 9.2. 

9.11 (a) Discussion. Let M > 0 and let m = inf{f n : n £ N}. We want 
s n +t n > M for large n, but it suffices to get s n + m> M or 
s n > M — m for large n. So select N so that s n > M — m for 
n> N. 

(b) Hint: If limt n > — oo, then inf{t n : n £ N} > — oo. Use part (a). 

9.13 If |a| < 1, then lima n = 0 by Theorem 9.7(b). If a = 1, then 
obviously lim a n = 1 . 

Suppose a > 1. Then 1 < 1, so lim(l/a) n = 0 as above. Thus 
lim l/a n = 0. Theorem 9.10 [with s n = a n ] now shows lima" = +oo. 
[This case can also be handled by applying Exercise 9.12.] 

Suppose a < — 1 and assume lima” exists. For even n, a n > 1 and 
for odd n, a n < — 1. Clearly lima" = +oo and lima™ = — oo are 
impossible. Assume lim a n = A for a real number A. There exists N 
such that \a n — A\ < 1 for n > N. For even n this implies A > 0 and 
for odd n this implies A < 0, a contradiction. 

9.15 Apply Exercise 9.12 with s n = a n /n\. Then L = lim [s^+i/snl = 
lim = 0 , so lim s n = 0 . 

9.17 Discussion. Let M > 0. We want n 2 > M or n > \[M. So let 
N = VM. 

10.1 increasing: (c); decreasing: (a), (f); bounded: (a), (b), (d), (f). 

10.3 The equality in the hint can be verified by induction; compare 
Exercise 1.5. Now by (1) in Discussion 10.3 we have 


= K+ — 
10 


dn 

1(7 


< K -\ - 

10 


- <K+ 1. 

10 " 


10.7 Let t = sup S. For each n £ N, t — ~ is not an upper bound for S, 
so there exists s n satisfying t — ~ < s n < t. Now apply the squeeze 
lemma in Exercise 8.5. 

10.9 (a) s 2 = 5 , s 3 = g, S 4 = is- 
(b) First we prove 


0 < s„+i < s n < 1 for all n > 1. 


(1) 
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This is obvious from part (a) for n = 1,2,3. Assume (1) holds 
for n. Then s„+i < 1, so 


Sn+2 


n + 1 2 _ f n+1 \ 

W+2 Sn+1 ~ V7+2 S,l+ V Sn+1 < Sn+1 


since (^±|)s n+ i < 1. Since s ra+ i > 0 we also have s n+ 2 > 0. 
Hence 0 < s n+ 2 < s n+ i < 1 and (1) holds by induction. 
Assertion (1) shows (s n ) is a bounded monotone sequence, so 
(s„) converges by Theorem 10.2. 

(c) Let s = lims n . Using limit theorems we find s = limSn+i = 
lim ^qbj- • lims^ = s 2 . Consequently s = 1 or s = 0. But s = 1 
is impossible since s n < \ for n > 2. So s = 0. 

10.11 (a) Show (t n ) is a bounded monotone sequence. 

(b) The answer is not obvious! It turns out that limt„ is a Wallis 
product and has value ^ which is about 0.6366. Observe how 
much easier part (a) is than part (b). 


11.1 (a) 1, 5, 1, 5, 1, 5, 1, 5 

(b) Let cr(k) = rife = 2k. Then ( a nk ) is the sequence that takes the 
single value 5. [There are many other possible choices of o\] 

11.3 (b) For (s n ), the set S of subsequential limits is{—1, —1,|,1}. For 
C tn ), S = {0}. For (u n ), S = {0}. For (/y„), S = {-1,1}. 

(c) lim sup s n = 1 , liminfsn = — 1 , lim sup t n = lim inf t n = 
limt n = 0 , lim sup u n = lim inf u n = limu n = 0 , limsupt? n = 1 , 
lim inf v n = — 1 . 

(d) ( t n ) and ( u n ) converge. 

(e) (s„), (f n ), ( u n ) and ( v n ) are all bounded. 

11.5 (a) [ 0 , 1 ]; (b) limsupg„ = 1 , liminfq , Il = 0 . 

11.7 Apply Theorem 11.2. 

11.9 (a) To show [a, b] is closed, we need to consider a limit s of a con¬ 
vergent sequence (s n ) from [a, b} and show s is also in [a, b ]. But 
this was done in Exercise 8.9. 

(b) No! (0,1) is not closed, i.e., (0,1) does not have the property 
described in Theorem 11.9. For example, t n = - defines a 
sequence in ( 0 , 1 ) such that t = limfjj does not belong to ( 0 , 1 ). 

11.11 Let t = supS 1 . There are several ways to prove the result. (1) 
Provide an inductive definition where Sk > max{sfc_i,f — j:} for 
all k. (2) Apply Theorem 11.2 directly. (3) Use the sequence (s n ) 
obtained in Exercise 10.7, and show t n = max{si,..., s n } defines an 
increasing sequence ( t n ) in S converging to t. 
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12.1 Let Un = inf{s n : n > N} and wn = inf{f„ : n > N}. Then ( un) 
and ( Wn ) are increasing sequences and un < wn for all N > No- 
By Exercise 9.9(c), lim inf s n = limujv < limuijv = lim inf t n . The 
inequality lim sup s n < lim sup t n can be shown in a similar way or 
one can apply Exercise 11.8. 

12.3 (a) 0; (b) 1; (c) 2; (d) 3; (e) 4; (f) 0; (g) 2. 

12.5 By Exercise 12.4, limsup(— s n — t n ) < limsup(— s n ) + limsup(— t n ), 
so — limsup(— (s n +t n )) > — limsup(— s n ) + [— limsup(— t n )]. Now 
apply Exercise 11.8. 

12.7 Let ( s nj ) be a subsequence of (s n ) such that lim^oo s n . = +oo. [We 
used j here instead of k to avoid confusion with the given k > 0.] 
Then Hindoo ks nj = +oo by Exercise 9.10(a). Since ( ks nj ) is a 
subsequence of ( ks n ), we conclude limsup(fcs n ) = +oo. 

12.9 (a) Since lim inf t n > 0, there exists Aq such that m = inf{f n : n > 
Ni} > 0. Now consider M > 0. Since lims^ = Too, there exists 
N 2 such that s n > ^ for n > N 2 . Then n > maxIA^i, A^} 
implies s n t n > {^)t n > (^)m = M. Hence lims„t n = + 00 . 

12.11 Partial Proof Let M = liminf |s n +i/s„| and /? = lim inf \s n \ 1 t n . 
To show M < it suffices to prove M\ < j3 for all < M. Since 


lim inf 


^n+l 

Sn 


lim inf 

N—t 00 


there exists N such that 


^n+l 

Sn 


: n > N 


> Mi, 


inf 


Sn+l 

Sn 


: n> N 


> Mi. 


Now imitate the proof in Theorem 12.2, but note that many of the 
inequalities will be reversed. 

12.13 Proof of sup A = liminf s n . Consider N in N and observe Un = 
infjsn : n > N} is a number in A, since {n £ N : s n < Un} Q 
{1,2,..., A^}. So un < sup A for all N and consequently liminf s n = 
lim un < sup A. 

Next consider a £ A. Let No = max{n e N : s n < a} < 00 . Then 
s n > a for n > No- Thus for N > Nq we have Un = inf{s„ : 
n > N} > a. It follows that liminf s n = limuAr > cl. We have just 
shown that lim inf s n is an upper bound for the set A. Therefore 
lim inf s n > sup A. 

13.1 (a) It is clear that d\ and c ?2 satisfy D1 and D2 of Definition 13.1. 

If x, y 1 z £ K fc , then for each j = 1,2,..., k, 


\ x i ~Zj\< I Xj -Vj\ + |Vj -Zj\ < d 1 (x,y) + d 1 (y,z), 
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so di(x,z) < di(x,y) + di(y,z). So d\ satisfies the triangle 
inequality and a similar argument works for d 2 ; give it. 

(b) For the completeness of d\ we use Theorem 13.4 and the 
inequalities 

di{x,y) < d(x,y) < Vkdx{x,y). 

In fact, if (x n ) is Cauchy for d\, then the second inequality 
shows (x n ) is Cauchy for d. Hence by Theorem 13.4, for some 
x £ R fc we have lim d(x n ,x) = 0. By the first inequality, we 
also have lim d\ ( x n , x) = 0, i.e., (x n ) converges to x in the met¬ 
ric d\. For d 2 , use the completeness of d\ and the inequalities 
di(x,y) < d- 2 {x,y) < kdi{x,y). 

13.3 (b) No, because d*(x,y) need not be finite. For example, consider 
the elements x = (1,1,1 ,...) and y = (0,0, 0,...). 

13.7 Outline of Proof Consider an open set U C R. Let (q n ) be an 
enumeration of the rationals in U. For each n, let 

On = inf{a e R : {a,q n ] C [/}, b n = sup{6 S K : [q n ,b) C U}. 

Show ( a n ,b n ) C U for each n and U = U^Li( a n; b n ). Show 

^n) C (u-Tn) ^m) 7^ ^ implies (u n , 6 n ) — (u m , &m). 

Now either there will be only finitely many distinct [and disjoint] in¬ 
tervals or else a subsequence {( a nk , b nic )}’^ =1 of {(a n , b n )} will consist 
of disjoint intervals for which {J^Li{a nk , b nk ) = U. 

13.9 (a) (I : n S N} U {0}; (b) R; (c) [-y/2, y/2]. 

13.11 Suppose E is compact, hence closed and bounded by Theorem 13.12. 
Consider a sequence (x n ) in E. By Theorem 13.5, a subsequence of 
( x n ) converges to some x in R fc . Since E is closed, x must be in E\ 
see Proposition 13.9(b). 

Suppose every sequence in E has a subsequence converging to a 
point in E. By Theorem 13.12, it suffices to show E is closed and 
bounded. If E were unbounded, E would contain a sequence (x n ) 
where limd(® I i,0) = +oo and then no subsequence would converge 
at all. Thus E is bounded. If E were nonclosed, then by Proposi¬ 
tion 13.9 there would be a convergent sequence (x n ) in E such that 
x = \vmx n £ E. Since every subsequence would also converge to 
x qL E, we would have a contradiction. 
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13.13 Assume, for example, that supl? ^ E. The set E is bounded, so by 
Exercise 10.7, there exists a sequence (s n ) in E where lim s n = sup E. 
Now Proposition 13.9(b) shows sup E £ E, a contradiction. 

13.15 (a) F is bounded because d(x, 0) < 1 for all x £ F where 0 = 
(0, 0,0,...). To show F is closed, consider a convergent sequence 
(x( n )) in F. We need to show x = liman”) is in F. For each 
3 = 1,2,... 


it is easy to see lim „_>. 00 a^" = Xj . Since each 
belongs to [—1,1], Xj belongs to [—1,1] by Exercise 8.9. It 
follows that x £ F. 

For the last assertion of the hint, observe 


(b) 


x 


(n) )3 .( m ) in imp i ies d ( x 


(n) 


x ( m )) < d{x^ n \x) + 

2 for m 7 ^ n. Now show 


14.1 


(a), 

(d) 

(e) 

(f) 


d(x 1 x^) < 2 while d(x^ n \x^ m ' > ) 
no finite subfamily of U can cover : n £ N}. 

(b), (c) Converge; use Ratio Test. 

Diverges; use Ratio Test or show nth terms don’t converge to 
0 [see Corollary 14.5]. 

Compare with 53 1/n 2 . 

Compare with Y — 

14.3 All but (e) converge. 

14.5 (a) We assume the series begin with n = 1. Let s n = Y'j-i a j 
and t n = Yj=i bj- We are given lim s n = A and lim t n = B. 
Hence lim(s n + t n ) = A + B by Theorem 9.3. Clearly s n + 
t n = Yj=i( a j + bj) is the nth partial sum for Y( a n + b n ), so 
Y( a n + bn) = lim(s„ + t n ) = A + B. 

(c) The conjecture is not even reasonable for series of two terms: 

ai&i + a 2 b - 2 7^ (ai + a 2 )(&i + b 2 ). 

14.7 By Corollary 14.5, there exists N such that a n < 1 for n > N. Since 
p > 1, a? = a„aP _1 < a n for n > N. Hence Y™=n+i a n converges 
by the Comparison Test, so Y a n also converges. 

14.9 Hint: Let Nq = max{n £ N : a n 7 ^ b n } < 00 . If n > m > Nq, then 


E n _ n 7 

k=m Q'k 2-~/k=m ®k‘ 

14.11 Assume a n +\/a n = r for n > 1. Then a 2 = ra 1 , 03 = r 2 a 2 , etc. 
A simple induction argument shows a n = r n ~ 1 a 1 for n > 1. Thus 
Y a n = Y air™- 1 is a geometric series. 

14.13 (a) 2 and -§. 

(b) Note 
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since the intermediate fractions cancel out. Hence lims n = 1. 

(d) 2. 

15.1 (a) Converges by Alternating Series Theorem. 

(b) Diverges; note lim(n!/2 n ) = +oo by Exercise 9.12(b). 

15.3 Hint: Use integral tests. Note 


lim 

n—> oo 



l 

x(log x)P 


dx = 


lim 

n—too 




15.5 There is no smallest po > 1, so there is no single series ^ l/n Po with 
which all series l/ti p [p > 1 ] can be compared. 

15.7 (a) Proof Let e > 0. By the Cauchy criterion, there exists N 
such that n > m > N implies | Y^k=m a k\ < f • I 11 particular, 


n > N implies 


e 

O-N+l + ‘ ‘ ' + On < 2' 


So n > N implies 


(n 


N)a n < apf+i + • • • + d n < —. 


If n > 2 N, then n < 2(n — N), so na n < 2(n — A)a n < e. This 
proves lim (na n ) = 0 . 

16.1 (a) In other words, show 


2 + 7-10 1 + 4-10 2 +V9-10 J = 2 + 7-10 1 + 5-10 2 = —. 

4 

i=3 

The series is a geometric series; see Example 1 of §14. 

(b) 2.750 

16.3 Let A and B denote the sums of the series. By Exercise 14.5, we have 
B — A = b n — a n ). Since b n — a n > 0 for all n, and b n — a n > 0 
for some n, we clearly have B — A > 0. 

16.5 (a) .1250 and .1249; (c) .6; (e) .54 

16.7 No. 

16.9 (a) 7 „ - 7 n +i = /" +1 t~ l dt - ^ > 0 since ^ < f -1 for all t in 
[n, n + 1 ). 

(b) For any n, j n < 71 = 1. Also 



(c) Apply Theorem 10.2. 

(a) dom (f+g) = dom (fg) = (- 00 ,4], dom(/o 5 ) = [- 2 , 2 ], dom(go 
/) = (— 00 ,4]. 


17.1 
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(b) fog(0) = 2 , 30/(0) = 4, fog(l) = y/3, 30/(1) = 3 , fog(2) = 0 , 
5 o/(2) = 2. 

(c) No! 

(d) / o 3(3) is not, but 3 o /( 3 ) is. 

17.3 (a) We are given f(x) = cosx and g(x) = x 4 [p = 4] are continu¬ 


ous. So 3 o / is continuous by Theorem 17.5, i.e., the function 
3 o /(x) = cos 4 x is continuous. Obviously the function iden¬ 


tically 1 is continuous [if you do not find this obvious, check 
it]. Hence 1 + cos 4 x is continuous by Theorem 17.4(i). Finally 
log e (l + cos 4 2 ;) is continuous by Theorem 17.5 since this is 
h o k(x) where k(x) = 1 + cos 4 x and h(x) = log e x. 

(b) Since we are given sin x and x 2 are continuous, Theorem 17.5 
shows sin 2 x is continuous. Similarly, cos 6 x is continuous. Hence 
sin 2 x + cos 6 x is continuous by Theorem 17.4(i). Since sin 2 x + 
cos 6 x > 0 for all x and since x 7r is given to be continuous for 
x > 0, we use Theorem 17.5 again to conclude [sin 2 x + cos 6 x ] 7r 
is continuous. 

(e) We are given sin x and cosx are continuous at each x £ R. So 
Theorem 17.4(iii) shows = tanx is continuous wherever 
cosx 7 ^ 0, i.e., for x 7 ^ odd multiple of |. 

17.5 ( a) Remarks. An e-5 proof can be given based on the identity 


x m - y m = (x - 3 )(x m - 1 + x m ~ 2 y + ---+xy 



Or the result can be proved by induction on m, as fol¬ 
lows. It is easy to prove g(x) = x is continuous on R. If 
/(x) = x m is continuous on R, then so is (fg)(x) = x m+1 
by Theorem 17.4(h). 

(b) Just use (a) and Theorems 17.4(i) and 17.3. 

17.9 (a) Discussion. Let e > 0. We want |x 2 —4| < e for |x — 2| small, i.e., 
we want |x — 2| • |x + 2] < e for |x — 2| small. If |x — 2| < 1, then 
|x + 2| < 5, so it suffices to get |x — 2| - 5 < e. Set 5 = min{l, |}. 

(c) For e > 0, let S = e and observe 


|x — 0 | < 6 implies 



17.11 If / is continuous at Xq and if (x n ) is a monotonic sequence in dom(/) 
converging to xq, then we have lim/(x n ) = f(x 0 ) by Definition 17.1. 
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Now assume 

if (x n ) is monotonic in dom(/) and limx n = xo, , , 

then lim/(x„) = f(x 0 ), 

but / is discontinuous at xq. Then by Definition 17.1, there exists 
a sequence (x n ) in dom(/) such that limx„ = Xo but (f(x n )) does 
not converge to f(x o). Negating Definition 17.1, we see there exists 
e > 0 such that 

for each N there is n > N satisfying \f(x n ) — f(x o)| > e. (2) 

It is easy to use (2) to obtain a subsequence (x„ k ) of (x n ) such that 

| f(x nk ) ~ f{x o)| > e for all k. (3) 

Now Theorem 11.4 shows (x„ k ) has a monotonic subsequence (x„ k . ). 
By (1) we have lim^oo f(x nk .) = f(x o), but by (3) we have 
| f{x nk ) — /(* 0 )| > e for all j , a contradiction. 

17.13 (a) Hint: Let x £ K. Select a sequence (x n ) such that limx n = 
x, x n is rational for even n, and x n is irrational for odd n. 
Then f(x n ) is 1 for even n and 0 for odd n, so {f(x n )) cannot 
converge. 

17.15 We abbreviate 

(i) / is continuous at xo, 

(ii) lim/(x n ) = f(x 0 ) for every sequence (x n ) in dom(/) \ {x 0 } 
converging to xq. 

From Definition 17.1 it is clear that (i) implies (ii). Assume (ii) 
holds but (i) fails. As in the solution to Exercise 17.11, there is a 
sequence (x n ) in dom(/) and an e > 0 such that limx„ = xq and 
| f{x n ) — /(x 0 )| > e for all n. Obviously x n ^ Xq for all n, i.e., (x n ) 
is in dom(/) \ {xo}. The existence of this sequence contradicts (ii). 
18.3 This exercise was deliberately poorly stated, as if / must have a 
maximum and minimum on [0, 5); see the comments following The¬ 
orem 18.1. The minimum of / on [0, 5) is 1 = /(0) = /(3), but / has 
no maximum on [0, 5) though sup{/(x) : x £ [0, 5)} = 21. 

18.5 (a) Let h = f—g. Then h is continuous [why?] and h(b) < 0 < h(a). 
Now apply Theorem 18.2. 

(b) Use the function g defined by g(x) = x for x £ [0,1]. 

18.7 Hint: Let f(x) = xe x -, / is continuous, /(0) = 0 and /(1) = e. 

18.9 Let /(x) = ao + a\X + • • • + a n x n where a n ^ 0 and n is odd. We 
may suppose a n = 1; otherwise we would work with (1 /a n )f. Since 
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/ is continuous, Theorem 18.2 shows it suffices to show f(x) < 0 
for some x and f(x) > 0 for some other x. This is true because 
Hindoo /(x) = +oo and lima, _>_(*, f(x) = — oo [remember a n = 1 ], 
but we can avoid these limit notions as follows. Observe 


f(x) = s" 


CLq + CL\X + • • • + d n — lX 


,n— 1 


(i) 


Let c = 1 + |ao| + |ai| H-b |a n _i|. If \x\ > c , then 


\clq + cl\X + • • • + a n —\X 


< (l°o| ■ 


l a l I 


• + |a„_i|)|x|” 1 < |ad 


so the number in brackets in (1) is positive. Now if x > c, then 
x n > 0, so f(x) > 0. And if x < — c, then x n < 0 [why?], so 
f{x) < 0 . 

19.1 Hints: To decide (a) and (b), use Theorem 19.2. Parts (c), (e), (f) 
and (g) can be settled using Theorem 19.5. Theorem 19.4 can also be 
used to decide (e) and (f); compare Example 6 . One needs to resort 
to the definition to handle (d). 

19.3 (a) Discussion. Let e > 0. We want 


x _ y_ 

x + 1 y +1 

for \x — y | small, x, y £ [0, 2]. Since x + 1 > 1 and y + 1 > 1 
for x, y £ [0, 2], it suffices to get \x — y\ < e. So we let S = e. 
Formal Proof Let e > 0 and let S = e. Then x, y € [0, 2] and 
\x — y\ < 5 = e imply 


< e or 


x-y 


(x + l)(y + 1) 


< e 


I/O) - fiv) I = 


x-y 

0 + 1)0 + 1 ) 


< \x 


y I < e - 


19.5 


(b) Discussion. Let e > 0. We want \g(x) — g(y)\ = I ( 2 x-i)( 2 y-i) I < 
e for \x — y\ small, x > 1, y > 1. For x,y > 1, we have 2x — 1 > 1 
and 2y — 1 > 1, so it suffices to get |5 y — 5x| < e. So let S = |. 
You should write out the formal proof. 

(a) tanx is uniformly continuous on [0, j] by Theorem 19.2. 

(b) tanx is not uniformly continuous on [0, J) by Exercise 19.4(a), 
since the function is not bounded on that set. 

(c) Let h be as in Example 9. Then (sin x)h(x) is a continuous 
extension of (j)sin 2 x on (0, 7 r]. Apply Theorem 19.5. 

(e) is not uniformly continuous on (3,4) by Exercise 19.4(a), 
so it is not uniformly continuous on (3, oo) either. 
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(f) Remark. It is easy to give an e -8 proof that is uniformly 
continuous on (4, oo). It is even easier to apply Theorem 19.6. 

19.7 (a) We are given / is uniformly continuous on [A:,oo), and / is 

uniformly continuous on [0, k + 1] by Theorem 19.2. Let e > 0. 
There exist cq and 82 so that 

\x~ y\ < h, x,y e [ft, 00) imply \f(x)-f(y)\<e, 

\x~y\ <82, x,y£ [0,fc+l] imply \f(x) - f(y)\ < e. 

Let 8 = min{l, 8±, 82] and show 

\x ~ y\ < 8, x,y £ [0,00) imply \f(x) - f{y)\ < e. 

19.9 (c) This is tricky, but it turns out that / is uniformly contin¬ 

uous on R. A simple modification of Exercise 19.7(a) shows 
it suffices to show / is uniformly continuous on [l,oo) and 
(—oo,—l]. This can be done using Theorem 19.6. Note we 
cannot apply Theorem 19.6 on R because / is not differentiable 
at x = 0; also /' is not bounded near x = 0. 

19.11 As in the solution to Exercise 19.9(c), it suffices to show h is 
uniformly continuous on [l,oo) and (—00, —1]. Apply Theorem 19.6. 

20.1 lim^oo f(x) = lim a ._ >0 + f(x) = 1 ; f(x) = lim^-oo 

/Or) = -1; lim^o /Or) does NOT EXIST. 

20.3 lim x _ ) . 00 f(x) = lim x ^_ 00 f(x) = 0; lim x _ ) . 0 + f(x) = lim^o- 
f{x) = ]im x ^ 0 f(x) = 1 . 

20.5 Let S = (0, 00). Then f(x) = 1 for all x € S. So for any sequence 
(x n ) in S we have lim/(x n ) = 1. It follows that linx^ 0 sf(x) = 
li m :r—>oo s «/*(^) ffa') lim a:—>-00 f(x) = 1. Like¬ 

wise if S = (—oo,0), then lim x _^ 0 s f(x) = lim x _>_ 00 s f(x) = —1, 
so lim x _> 0 - f(x) = limaj-^-oo f(x) = —1. Theorem 20.10 shows 
lim x _>o f{x) does not exist. 

20.7 If (, x n ) is a sequence in (0,oo) and limx n = +00, then Y\m.{l/x n ) 

= 0. Since (sina;^) is a bounded sequence, we conclude lim(sina;„)/ 
x n = 0 by Exercise 8.4. Hence lim^,*, f(x) = 0. Similarly 

lim x _,._ 00 f[x) = 0. The remaining assertion is lim x _^o = 1 
which is discussed in Example 9 of §19. 

20.9 lim x _>. 00 f(x) = -00; lim x _ >0 + f(x) = +00; lim x _> 0 - f(x) = -00; 
lim^-oo f(x) = +00; lim x _ > o f{x) does NOT EXIST. 

20.11 (a) 2a; (c) 3a 2 . 
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20.13 First note that if lim^^aS f(x) exists and is finite and if k £ R, then 
lim a ,_ ) . Q s (kf)(x) = k ■ line^aS f{x). This is Theorem 20.4(h) where 
/i is the constant k and f 2 = f. 

(a) The remark above and Theorem 20.4 show 

lim [3/(:r) + g{x) 2 ] = 3 lim f(x) + [lim g(x )] 2 = 3 • 3 + 2 2 = 13. 

x—^a x—^a x—>a 

(c) As in (a), lim x _>. a [3/(:z;) + 8 g(a;)] = 25. There exists an open 
interval J containing a such that f{x) > 0 and g(x) > 0 for x £ 
J\{a}. Theorem 20.5 applies with S = J\{a}, 3f + 8 g in place 
of / and with g(x) = yfx to give lim^a y/3f(x) + 8 g(x) = 
y/25 = 5. 

20.15 Let ( x n ) be a sequence in (—oo, 2) such that lim:r„ = —oo. We 
contend 

lim(a; ra — 2) -3 = 0 . ( 1 ) 

We apply Exercises 9.10 and 9.11 and Theorems 9.9 and 9.10 to 
conclude lim(— x n ) = +oo, lim (2 — x n ) = +oo, lim (2 — x n ) 3 = +oo, 
lim (2 — x n )~ 3 = 0 , and hence ( 1 ) holds. 

Now consider a sequence ( x n ) in (2,oo) such that lima; n = 2. We 
show 

lim(x„ — 2) -3 = +oo. ( 2 ) 

Since lim(x„ — 2) = 0 and each x n — 2 > 0, Theorem 9.10 shows 
we have lim(a; rl — 2) _1 = +oo and ( 2 ) follows by an application of 
Theorem 9.9. 

20.17 Suppose first that L is finite. We use (1) in Corollary 20.8. Let e>0. 
There exist <5i > 0 and £3 > 0 such that 

a < x < a + 8 \ implies L — e < fi(x) < L + e 

and 

a < x < a + S 3 implies L — e < fs(x) < L + e. 

If 8 = min{(5i, A 3 }, then 

a < x < a + 8 implies L — e < f 2 {x) < L + e. 

So by Corollary 20.8 we have lim a ,_ ) . a + f 2 (x) = L. 

Suppose L = + 00 . Let M > 0. In view of Discussion 20.9, there 
exists 8 > 0 such that 

a < x < a + 8 implies /1 (x) > M. 
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Then clearly 


a < x < a + S implies fi ( x) > M, 

and this shows lim a ._ ) . a + f 2 {x) = +oo. The case L = —oo is similar. 
20.19 Suppose L 2 = lim 3 ,.^ 0 s f(x) exists with S = (a, 62)- Consider a se¬ 
quence (x n ) in (a, b \) with limit a. Then (x n ) is a sequence in (a, 62) 
with limit a, so lim/(x n ) = L 2. This shows lmr^aS f(x) = L 2 with 
S = (a, 61). 

Suppose L 1 = lim a ._ >Q s f(x) exists with S = (a, b±), and consider a 
sequence (x n ) in (a, 62) with limit a. There exists N so that n> N 
implies x n < b\. Then (xn)™^ is a sequence in (a, 61) with limit a. 
Hence lim/(x n ) = L\ whether we begin the sequence at n = N or 
n = 1. This shows lim a ,_ ) , Q s f(x) = L\ with S = (a, 62)- 
21.1 Let e > 0. For j = 1,2, ..., k, there exist Sj > 0 such that 

s,t € K and |s - t\ < Sj imply | fj(s) - f 3 (t)\ < ~^=. 

Let S = min{i5i, S 2 , ■ ■ ■, Sk}- Then by (1) in the proof of Propo¬ 
sition 21.2, 

i,t£l and |s — t| < <5 imply d*(7(s),7(t)) < e. 

21.3 Hint: Show \d(s, s 0) — d(t, So)| < d(s, t). Hence if e > 0, then 

s,t € S and d(s,t) < e imply |/(s) — f(t)\ < e. 

21.5 (b) By part (a), there is an unbounded continuous real-valued func¬ 
tion / on E. Show h = jqqyy is continuous, bounded and does 
not assume its supremum 1 on E. 

21.7 (b) 7 is continuous at to if for each to £ [a, 6] and e > 0 there exists 
5 > 0 such that 

t S [a, b] and \t — to\ < 6 imply d*( 7(t),7(to)) < £• 

Note: If 7 is continuous at each to £ [a, 6], then 7 is uniformly 
continuous on [a, b] by Theorem 21.4. 

21.9 (a) Use f(x 1,^2) = aq, say. 

(b) This is definitely not obvious, but there do exist continuous 
mappings of [0,1] onto the unit square. Such functions must be 
“wild” and are called Peano curves [after the same Peano with 
the axioms]; see [16, §5.5] or [55, §6.3]. 




Selected Hints and Answers 385 


21.11 If Q were equal to n%L 1 U n , where each U n is open, then D 
n rg Q(K \ {r}) would be an intersection of a sequence of open sets 
that is equal to the empty set, contrary to Theorem 21.7(a). 

21.13 Suppose uif(x) = 0. Given e > 0, there is 8 > 0 so that 

sup{|/(y) - f(z) | : y, z £ {x - <5, x + <5)} < e. 

Then |/(x) — f(y)\ < e for all y £ (x — 8, x + 8), i.e., \x — y\ <8 
implies |/(x) — f(y) | < e. So / is continuous at x. The proof that 
continuity of / at x implies w/(x) = 0 is similar. 

22.1 (a) [0,1] is connected but [0,1] U [2,3] is not. See Theorem 22.2. 
Alternatively, apply the Intermediate Value Theorem 18.2. 

22.3 Assume E is connected but E~ is not. Then there exist open sets 
U\ and U 2 that separate E~ as in Definition 22.1(a). Show that U\ 
and U 2 separate E , which is a contradiction. Since E satisfies (1) in 
Definition 22.1(a), it suffices to show E D Z7i 7^ 0 and E D U 2 7^ 0- 
In fact, if E n U\ = 0, then E~ D (S \ U\) would be a closed set 
containing E, and it is smaller than E~ since E~ n U\ 7^ 0. This 
contradicts the definition of E~ in Dehnition 13.8, so E n Ui 7^ 0. 
Likewise E n U 2 7^ 0. 

22.5 (a) Assume open sets U\ and U 2 separate E U F as in Defini¬ 
tion 22.1(a). Consider x £ E D F; x belongs to one of the 
open sets, say x £ U\. Select y in (E U F) fl L^. Then y is in 
E or F, say y £ E. Since x £ E fl U\ and y £ E fl U 2 , these 
sets are nonempty. Thus U\ and U 2 separate E, and E is not 
connected, a contradiction. 

(b) No such example exists in R [why?], but many exist in the 
plane. 

22.9 Discussion. Given e > 0, we need <5 > 0 so that 

s,teK and |s — t| < 8 imply d(F(s), F(t)) < e. (1) 


Now 

d(F{s), F(t )) = sup{| sf(x) + (1 - s)g{x) - tf(x) - (1 - t)g(x)\ : x £ S} 
= sup{|s/(x) - tf(x) - sg(x) + tg(x)\ : x £ S} 

< \s ~ t\ ■ sup{|/(x)| + |fl(x)| : x £ S}. 

Since / and g are fixed, the last supremum is a constant M. We may 
assume M >0, in which case 8 = -h will make (1) hold. 
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22.11 (a) Let (/„) be a convergent sequence in £. By Proposition 13.9(b), 
it suffices to show / = lim/„ is in £. For each x G S, 

\f(x)\ < | f(x) - fn(x )I + \fn(x)\ < d{f , f n ) + 1. 

Since lim d(f,f n ) = 0, we have |/(x)| < 1. 

(b) It suffices to show C(S) is path-connected. So use 
Exercise 22.9. 

23.1 Intervals of convergence: (a) (—1,1); (c) [—|, |]; (e) R; (g) [— |, |). 

23.3 {-$2, y/2). 

23.5 (a) Since \a n \ > 1 for infinitely many n, we have sup{|a n | 1 / n : 

n > N} > 1 for all N. Thus /3 = limsup |a ra | 1 / rl > 1; hence 
R = ± < 1. 

(b) Select c so that 0 < c < lim sup |a n |. Then sup{|a„| : n > 
N} > c for all N. A subsequence (a Uk ) of (a n ) has the 
property that \a nk \ > c for all k. Since \a nk \ 1 ^ nk > (c) 1 /"' ! and 
limfc-^oo c 1 / nfe = 1 [by Theorem 9.7(d)], Theorem 12.1 shows 
lim sup \a nk \ 1 / nk > 1. It follows that /3 = lim sup Ian] 1 /" > 1 
[use Theorem 11.8]. Hence R = ^ < 1. 

23.9 (a) Obviously lim/„(0) = 0. Consider 0 < x < 1 and let s n = 

nx n . Then s n+ i/s n = so lim|s„+i/s„| = x < 1. 

Exercise 9.12(a) shows 0 = lims„ = limna;" = lim/ n (a;). 

24.1 Discussion. Let e > 0. We want | f n (x) — 0| < e for all x and for 
large n. It suffices to arrange for < e for large n. So consider 
n > 9/e 2 = N. 

24.3 (a) fix) = 1 for 0 < x < 1; /(1) = \\ f(x) = 0 for x > 1. See 

Exercise 9.13. 

(b) ( f n ) does not converge uniformly on [0,1] by Theorem 24.3. 

24.5 (a) f{x) = 0 for x < 1 and /( x) = 1 for x > 1. Note f n (x) = 

1/(1 + n/x n ) and lim^oo n/x n = 0 for x > 1 by Exercise 9.12 
or 9.14. 

(b) f n 0 uniformly on [0,1]. Hint: Show |/ n (x)| < ^ for x € 
[0,1]- 

(c) Hint: Use Theorem 24.3. 

24.7 (a) Yes. f(x) = x for x < 1 and /(1) = 0. 

(b) No, by Theorem 24.3 again. 

24.9 (a) f(x) = 0 for x £ [0,1]. For x < 1, lim^oo nx n = 0 as in 

Exercise 23.9(a). 

(b) Use calculus to show f n takes its maximum at Thus 

sup{|/„(a:)| : x G [0,1]} = = (^t)” +1 . As in Exam- 
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pie 8, it turns out lim/ n (^pj-) = 1/e. So Remark 24.4 shows 
ifn) does not converge uniformly to 0. 

(c) Jo f n (x) dx = (n+1) " (n+2) ->0 = f(x) dx. 

24.15 (a) /(0) = 0 and f(x) = 1 for x > 0. (b) No. (c) Yes. 

24.17 Hint: Use | f n {x n ) - f(x)\ < \f n (x n ) - f{x n )| + | f(x n ) - f(x )|. 

25.3 (a) Since f n {x) = (1 + (cosx)/n)/(2 + (sin 2 x)/n), we have /„ —> \ 
pointwise. To obtain uniform convergence, show 


, , , 1 


2 cos x — sin 2 x 

fn(x) - g 

— 

2(2 n + sin 2 x) 


< 


2(2n) 


< e 


for all real numbers x and all n > -£ 

(b) fj^dx= §, by Theorem 25.2. 

25.5 Since f n —>f uniformly on S, there exists N £ N such that n > N 
implies | f n (x) — f(x )| < 1 for all x £ S. In particular, we have 
|/at+i(x) — f(x ;)| < 1 for x £ S. If M bounds |/at+i| on S [i.e., if 
|/at+i(x)| < M for x £ 5], then M + 1 bounds |/| on S [why?]. 

25.7 Let g n {x) = n ~ 2 cosnx. Then we have \g n {x)\ < n -2 for x £ R and 
n~ 2 < oo. So 9n converges uniformly on R by the Weierstrass 
M-Test 25.7. The limit function is continuous by Theorem 25.5. 

25.9 (a) The series converges pointwise to 0 n (—1,1) by (2) of Ex¬ 
ample 1 in §14. The series converges uniformly on [—a, a] by the 
Weierstrass M-Test since |a:"| < a n for x £ [—a, a] and since 
53 a n < oo. 

(b) One can show directly that the sequence of partial sums 
s n (x) = 53fc=o % k = (1 — x n+1 )/(l — x) does not converge uni¬ 
formly on (—1,1). It is easier to observe the partial sums s n are 
each bounded on (—1,1), and hence if (s n ) converges uniformly, 
then the limit function is bounded by Exercise 25.5. But 
is not bounded on (—1,1). 

25.11 (b) Hint: Apply the Weierstrass M-Test to J2hn, where h n (x) = 
( \) n 9n{x ). 

25.13 The series 53 9 k an d 53 dk are uniformly Cauchy on S and it suffices 
to show 53 ( 9 k + hk) is also; see Theorem 25.6. Let e > 0. There exist 
Ni and N 2 such that 


n> m > N\ implies 


n > m > N 2 implies 


n 

9k{x) 

k=m 

n 

hk ^ 

k=m 



e 


< 2 


for x £ S', 


for x £ S. 


(1) 

( 2 ) 
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Then 

n > m > max{Ai, W} implies 


( 9k + h k )(x] 


< e for x £ S. 


25.15 (a) Note f n (x) > 0 for all x and n. Assume (/„) does not converge 
to 0 uniformly on [a, b\. Then there exists e > 0 such that 


for each N there exists n > N and x £ [a, b] 
such that f n (x) > e. 


( 1 ) 


We claim 


for each n £ N there is x n £ [a, b] where f n (x n ) > £• (2) 

If not, there is no £ N such that f no (x) < e for all x £ [a, 6]. 
Since is decreasing for each x. we conclude f n (x) < e 

for all x £ [a, b\ and n > no- This clearly contradicts (1). We 
have now established the hint. 

Now by the Bolzano-Weierstrass theorem, the sequence (x n ) 
given by (2) has a convergent subsequence ( x nk ): x nk —> Xo- 
Since lim/ n (xo) = 0, there exists m such that f m (x 0) < e. 
Since x nk —>■ xo and f m is continuous at xo, we have 
limfc-j.oo fm(x nk ) = fm{x o) < £. So there exists K such that 

k > K implies f m {x nk ) < £■ 

If k > maxlit', m}, then rik> k > to, so 

fn k (Xn k ) 5; .fm(x nk ) < £■ 


But fnixn) > e for all n, so we have a contradiction. 

(b) Hint: Show part (a) applies to the sequence g n where g n = 

f ~ fn- 

26.3 (a) Let f(x) = Y^'^Li nxn = x /(l — x ) 2 f° r l^l < 1- Then by 
Theorem 26.5 


00 7 

n= 1 




= (1 + x)(l — x) 


-3. 


therefore n 2 x n = (x + x 2 )(l — x)~ 3 . 

(b) 6 and |. 

26.5 Hint: Apply Theorem 26.5. 

26.7 No! The power series would be differentiable at each x £ R, but 
f(x) = |x| is not differentiable at x = 0. 
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27.1 Let (f> be as in the hint. By Theorem 27.4, there is a sequence (q n ) 
of polynomials such that q n -+ f ° (j) uniformly on [0,1]. Note 4> is 
one-to-one and Let p n = q n o 3 _1 . Then each p n is a 

polynomial and p n —> f uniformly on [a, b\. 

27.3 (a) Assume a polynomial p satisfies \p{x) — sinx| < 1 for all x £ M. 

Clearly p cannot be a constant function. But if p is nonconstant, 
then p is unbounded on M and the same is true for p(x) — sin a:, 
a contradiction. 

(b) Assume \e x — J2k=o a k xk I < 1 f° r x £ F° r x > 0 we have 

n —1 1 n —1 

e x -^2 akxk - —\ xTl ~ X] \ ak \ xk 

k =0 ' k =0 


and for large x the right side will exceed 1. 

27.5 (a) B n f(x) = x for all n. Use (2) in Lemma 27.2. 

(b) B n f{x) = x 2 + Lx(l — x). Use (4) in Lemma 27.2. 

28.1 (a) {0}; (b) {0}; (c) {mr : n € Z}; (d) {0,1}; (e) {-1,1}; (f) 

{ 2 }. 

28.3 (b) Since a; — a = (x 1 / 3 — a 1 / 3 )(a; 2 / 3 + a 1 / 3 ^ 1 / 3 + a 2 / 3 ), 

/'(a) = lim^+a^^ + a 2 / 3 )- 1 = (3a 2 / 3 )" 1 = X" 2 / 3 

x—>a 3 

for a^O. 

(c) / is not differentiable at x = 0 since the limit lim^^o x^^/x 
does not exist as a real number. The limit does exist and equals 
+00, which reflects the geometric fact that the graph of / has 
a vertical tangent at (0,0). 

28.5 (c) Let 


h(x) = 


g(f( x )) -g(/(Q)) 

f( x ) - /(0) 


According to Definition 20.3(a), for lim^^o h(x) to be mean¬ 
ingful, h needs to be defined on J \ {0} for some open interval 
J containing 0. But the calculation in (b) shows h is undefined 
at (7rn)” 1 for n = ±1, ±2,.... 

28.7 (d) /' is continuous on M, but f is not differentiable at x = 0. 
28.9 (b) f{x) = x 4 + 13x and g(y) = y 7 . Then 


h\x) = g'(f(x )) • f'(x) = 7(x 4 + 13x) 6 • (4x 3 + 13). 


28.11 With the stated hypotheses, ho g o f is differentiable at a and (h o 
g o f)'( a ) = h'{g o /(a)) • g'(f{a)) ■ f'{a). Proof By 28.4, g o / is 
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differentiable at a and (g o f)'(a) = g'(f(a)) ■ Again by 28.4, 

(ho (go = h'((g o f)(a)) ■ ( g o /)». 

28.13 There exist positive numbers <5i and e so that / is defined on the 
interval (a — 8 \ , a + <5i) and g is defined on (/(a) — e, /(a) + e). By 
Theorem 17.2, there exists 82 > 0 so that 


x £ dom(/) and \x — a| < 82 imply \f(x) — f(a)\<e. 


If \x — a\ < min{<Ji,# 2 }, then x £ dom(/) and \f(x) — f(a)\ < e, so 
f(x) £ dom(g), i.e., x £ dom(g o /). 

29.1 (a) x=\ 

(c) If f(x) = |x|, then f'(x) = ±1 except at 0. So no x satisfies the 
equation f'(x) = = 3- Missing hypothesis: / is not 

differentiable on (—1,2), since / is not differentiable at x = 0. 
(e) x = V3 

29.3 (a) Apply Mean Value Theorem to [0,2]. 

(b) By the Mean Value Theorem, f(y) = 0 for some y £ (1,2). 
In view of this and part (a), Theorem 29.8 shows f takes all 
values between 0 and 

29.5 For any o £ M we have | 1 < \x—a\. It follows easily that f(a) 

exists and equals 0 for all a £ R. So / is constant by Corollary 29.4. 

29.7 (a) Applying 29.4 to f, we find f'(x) = a for some constant a. If 
g(x) = f(x) — ax, then g'(x) = 0 for x £ /, so by 29.4 there is 
a constant b such that g(x) = b for x £ I. 

29.9 Hint: Let f(x) = e x — ex for x £ K. Use f to show / is increasing 
on [1, 00 ) and decreasing on (— 00 ,1], Hence / takes its minimum at 
x = 1. 

29.13 Let h(x) = g(x) — f(x) and show h(x) > 0 for x > 0. 

29.15 As in Example 2, let g(x) = x 1 /". Since dom(gr) = [0, 00 ) if n is even 
and dom((/) = R if n is odd, we have dorn(g) = dom(/i) U {0}. Also 
h = g m . Use the Chain Rule to calculate h'(x). 

29.17 Suppose /(a) = g(a). Then 


h(x) — h(a) 

x—>a+ X — CL 


g'(a) and 


h(x) — h(a ) 
hm - 

x—^a~ X — CL 


/»■ (i) 


If also f'(a) = g'(a), then Theorem 20.10 shows h'(a) exists and, in 
fact, h'(a) = f'(a) = g'(a). 

Now suppose h is differentiable at a. Then h is continuous at a and 
so f(a) = lim.^- /(x) = lim x ^. a - h(x) = h(a ) = g(a). Hence (1) 
holds. But the limits in (1) both equal h'(a), so f'(a) = g'(a). 
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30.1 (a) 2; (b) ±; (c) 0; (d) 1. Sometimes L’Hospital’s rule can be 

avoided. For example, for (d) note that 

y /1 + x — \Jl — x 2 

X \/l -(- ~x T \/ 1 — ~x 

30.3 (a) 0; (b) 1; (c) +oo (d) — |. 

30.5 (a) e 2 ; (b) e 2 ; (c) e. 

31.1 Differentiate the power series for sinx term-by-term and cite 
Theorem 26.5. 

31.3 The derivatives do not have a common bound on any interval 
containing 1. 

31.5 (a) g{x) = f(x 2 ) for x £ R. where / is as in Example 3. Use in¬ 

duction to prove there exist polynomials p kn , 1 < k < n, so 
that 

n 

g( n \x) = y ^ (x 2 )pkn(x) for x£l,n>l. 

fc=l 

31.9 Use x n = x n -i — ■ To six places, the answer is 

0.739085. As always, use radians. 

31.11 For some C > 0, we have | f'(x)\ < C for x in (a, b). Then \ f{x n -\)\ < 
\x n — x n -\ \ ■ C for all n. Let n —> oo. 

32.1 Use the partition P in Example 1 to calculate U(f,P) = b 4 n 2 (ji + 
l) 2 /(4n 4 ) and L(f,P) = b A (n— l) 2 n 2 /(4n 4 ). Conclude U(f) = b 4 /4 
and L(f) = b 4 j 4. 

32.3 (a) The upper sums are the same as in Example 1, so U(g) = b 3 / 3. 

Show L(g) = 0. 

(b) No. 

32.5 S is all the numbers L(f,P), and T is all U(f,P). 

32.7 Assume f(x) = 0 for all x £ [a, b]. A simple induction shows we may 
assume g(x) = 0 except at one point u £ [a, b]. Clearly all lower sums 
L(g, P) = 0, so L(g) = 0. Since u belongs to at most two intervals 
of any partition P, we have 

U{g 1 P) < 2\g(u)\ max[ffc - t k - 1 ]. 
k 

Infer U ( g ) = 0; hence f*g = 0 = J* f. 

33.1 If / is decreasing on [a, 6], then — / is increasing on [a, b], so — / is 
integrable as proved in Theorem 33.1. Now apply Theorem 33.3 with 
c = —1. 

33.3 (b) 4A + 6B 
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33.7 (a) For any set S C [a, b] and xq, yo G S, we have 

/0o) 2 - /(yo) 2 < |/(3=o) + f{y 0 ) I ■ |/(so) - /(yo)| 

< 2B\f(x 0 ) - f{y 0 )\ < 2 B[M(f, S) - m(f, S)]. 


It follows that M(/ 2 , S) - m(f 2 ,S) < 2B[M(f, S ) - m(f, S)]. 
Use this to show U(f 2 , P) - P(/ 2 , P) < 2 B[U(f, P) - L(f, P )]. 
(b) Use Theorem 32.5 and part (a). 

33.9 Select m € N so that |/(x) — / m (a:)| < 2 ^ b e _ a ^ f° r a ll x G [ a ; &]■ Then 
for any partition P 

- , -<L(f-f m ,P)<U(f-f m ,P)< e -. 


Select a partition P 0 so that U(f m ,Po) ~ L(f m ,Po) < Since / = 
if—fm) + fm, we can use inequalities from the proof of Theorem 33.3 
to conclude U(f,Po) — L(f,P 0 ) < e. Now Theorem 32.5 shows / 
is integrable. To complete the exercise, proceed as in the proof of 
Theorem 25.2. 

33.11 (a) and (b): Show / is neither continuous nor monotonic on any 
interval containing 0. 

(c) Let e > 0. Since / is piecewise continuous on [|, 1], there is a 
partition Pi of [|, 1] such that [/(/, Pi) — L{f,P\) < |. Like¬ 
wise there is a partition P 2 of [— 1,— |] such that U(f, P 2 ) — 
L(f , P 2 ) < |. Let P = Pi U P 2 , a partition of [—1,1]. Since 



) - m (/, 


)}-{§-(-§)} 



we conclude U(f,P) — L(f,P) < e. Now Theorem 32.5 shows 
/ is integrable. 

33.13 Apply Theorem 33.9 to / — g. 

34.3 (a) F(x) = 0 for x < 0; F(x) = x 2 /2 for 0 < x < 1; F(x) = 4x — | 

for x > 1. 

(c) F is differentiable except possibly at x = 1 by Theorem 34.3. 
To show F is not differentiable at x = 1, use Exercise 29.17. 

34.5 F'(x) = f(x + 1) — f(x — 1). 

34.9 Use a = 0, b = | and g(x) = sins. 

35.3 (a) 21; (b) 14; (c) 0. 

35.5 (a) Every upper sum is F(b) — F(a) and every lower sum is 0. Hence 

U F (f) = F(b) - F(a) + 0 = L F {f). 

35.7 (a) Imitate solution to Exercise 33.7. 

(b) and (c): Use hints in Exercise 33.8. 
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35.9 (a) Let m and M be the [assumed] minimum and maximum of / 
on [a, b]. Then J^ m dF < j^ f dF < J^ M dF or m < [F(b) — 
E(a)] -1 f b f dF < M. Apply Theorem 18.2. 

(b) Consider / and g as in Exercise 33.14, and let F be as in 
Exercise 35.8. By part (a), for some x G [a, 6] we have 


/ f(t)g{t)dt=[fdF = f(x)[F(b)-F(a)] = f(x)[ g(t)dt. 

J a J a J a 


35.11 Let e > 0 and select a partition 


P = {a = to < ti <■■■< t n = b} 
satisfying U F (f, P) - L F (f, P) < e. Let u k = (j)~ l {t k ) and 


Q = {c = uo < u\ < ■ ■ ■ < u n — d}. 

Show U G (g,Q) = U F {f,P) and L G (g,Q) = L F (f,P). Then 
U G (g,Q) — LdgiQ) < e, so g is G-integrable. The equality of the 
integrals follows easily. 

36.1 Hint: If B bounds |/|, then 


f(x) dx — f(x) dx 


< B(b — d). 


36.3 (b) Use part (a) and Examples 1 and 2. 

36.7 (a) It suffices to show e ~ x2 dx < oo. But e ~ x2 < e~ x for x > 1 
and e~ x dx = 

(b) The double integral equals [j x e x dx] 2 , and it also equals 


/•OO /> 27 T /> oo 

/ / e~ r r d8 dr = 2 tt / e~ r r dr = n. 

Jo Jo Jo 

36.9 (a) Hint: Use Theorem 35.13. 

(b) 1; (c) +oo; (d) (e) 0. 

36.13 Claim: If / is continuous on R and jJJ ryo |/| dF < oo, then / is F- 
integrable. Proof Since 0 < / + |/|, the integral [/ + \f\]dF 
exists, and since / + |/| < 2|/|, this integral is finite, i.e., / + |/| 
is F-integrable. Since —1/| is F-integrable, Exercise 36.10 shows the 
sum of / + |/| and —1/| is F-integrable. 

36.15 (a) For example, let f n (x) = - for x G [0, n] and f n {x) = 0 
elsewhere. 

(b) Outline of Proof First, / is F-integrable on each [a, b] by 
Exercise 35.6. An elaboration of Exercise 25.5 shows there is 
a common bound B for |/| and all |/ n |. Consider any b > 0 
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such that 1 — F(b) < There exists a number N so that 
| / 0 b / dF — / 0 b f n dF\ < | for n > N. Then 


n > N implies 




< e. 


(1) 


In particular, m,n> N implies | / () °° f n dF — / Q °° f m dF | < 2e, 
so (r fn dF ) n6 N is a Cauchy sequence with a finite limit L. 
From (1) it follows that 


1 — F(b) < — implies 
2 B 


fdF-L 


< e, 


so limfi^oo Jq f dF = L. Hence 
and equals limn-j.oo J Q °° f n dF. A 

I- x f dF - 

37.1 Hint: 


/ 0 °° / dF exists, is finite, 
similar argument handles 


f yz 1 

r i r 

/ -dt- 

/ -dt = 

1 t 

Ji t Jy 


37.7 (a) B(x) = E(xL(b)), so by the Chain Rule, we have B'(x) = 
E(xL(b)) ■ L{b) = L(b)b x = (log e b)b x . 

37.9 (a) log e y = L{y) = f” \ dt < y - 1 < y. 

38.3 Apply the Fundamental Theorem of Calculus 34.3 to a continuous 
nowhere-differentiable function /. 


A Guide to the References 

There are many books with goals similar to ours, including: Bran- 
nan [12], Clark [16], and Pedrick [51]. Zorn [73] is a gentle, well 
written introduction with a strong first chapter on “numbers, sets 
and proofs.” Lay [41] also starts with sections on logic and proofs, 
and provides good answers. Abbott [1] appears to be a fine book, 
though lots of the text is left to the exercises. Bauldry [3] is a nice 
book designed for a last course in real analysis for those intending 
to go into teaching. Morgan [47] gives a concise introduction to the 
key concepts. 

Beardon [6] gives a coherent treatment of limits by defining the 
notion just once, in terms of directed sets. Bressoud [13] is a wonder- 
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ful book that introduces analysis through its history. Gardiner [23] 
is a more challenging book, though the subject is at the same level; 
there is a lot about numbers and there is a chapter on geometry. 
Hijab [32] is another interesting, idiosyncratic and challenging book. 
Note many of these books do not provide answers to some of the 
exercises, though [32] provides answers to all of the exercises. 

Rotman [61] is a very nice book that serves as an intermediate 
course between the standard calculus sequence and the first course in 
both abstract algebra and real analysis. I always shared Rotman’s 
doubts about inflicting logic on undergraduates, until I saw Wolf’s 
wonderful book [70] that introduces logic as a mathematical tool in 
an interesting way. 

More encyclopedic real analysis books that are presented at the 
same level with great detail and numerous examples are: Lewin and 
Lewin [43], Mattuck [46] and Reed [56]. I find Mattuck’s book [46] 
very thoughtfully written; he shares many of his insights (acquired 
over many years) with the reader. 

There are several superb texts at a more sophisticated level: 
Beals [4], Bear [5], Hoffman [33], Johnsonbaugh and Pfaffen- 
berger [34], Protter and Morrey [53], Rudin [62] and Stromberg [65]. 
Any of these books can be used to obtain a really thorough 
understanding of analysis and to prepare for various advanced 
graduate-level topics in analysis. The possible directions for study 
after this are too numerous to enumerate here. However, a reader 
who has no specific needs or goals but who would like an introduc¬ 
tion to several important ideas in several branches of mathematics 
would enjoy and profit from Gar ding [24]. 
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Symbols Index 


N [positive integers], 1 
Q [rational numbers], 6 
R [real numbers], 14 
Z [all integers], 6 
e, 37,344 
R fc , 84 

B n f [Bernstein polynomial], 218 

C(S), 184 

C“((a,/3)), 352 

d [a metric], 84 

dist(a, b), 17 

dom(/) [domain], 123 

F-mesh(P), 320 

J F (f,P),U F (f,P),L F (f,P), 300 
J u [jump function at u\, 301 
lim a ,_ >Q s f(x), 153 
lirn^a f(x), lim Ma+ f(x), 

lim^-s-oo f(x), etc., 154 
lims„, s n —> s, 35,51 
limsupSn, liminfs n , 60,78 
M(f, S),m(f, S), 270 
max S', min S, 20 


max(/,j),min(/, 5 ), 128 
mesh(P), 275 
n\ [factorial], 6 
(^) [binomial coefficients], 6 
R n {x) [remainder], 250 
sgn(x) [signum function], 132 
sup S, inf S, 22, 29 
[/(/), P(/), 270 
P(/,P),P(/,P), 270 
U F (f), L F (f), 301 
E°, 87 
E~, 88,171 

/' [derivative of /], 224 
/ [extension of /], 146 
/ _1 [inverse function], 137 

f + gjgj/gj ° g, 128 
F(t-),F(t+), 299 
f n —>f pointwise, 193 
fn -> / uniformly, 194 
/:S-> S*, 164 
—y s, 35 

(s nfc ) [subsequence], 66 
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°n [summation], 95 

./« / = fa /(*) dX ’ 270 ’ 331 

J b a fdF = J b a f(x)dF(x), 301 
f-oof dF > 334 


[a, b], (a, b), [a, 6), (a, 6], 20 
[a, oo), (a, oo), (—oo, 6], etc., 28 
+oo, — oo, 28 
0 [empty set], 366 



Index 


Abel’s theorem, 212 
absolute value, 17 
absolutely convergent series, 96 
algebraic number, 8 
alternating series theorem, 108 
Archimedean property, 25 
associative laws, 14 


Baire Category Theorem, 172,173 
basic examples, limits, 48 
basis for induction, 3 
Bernstein polynomials, 218 
binomial series theorem, 255 
binomial theorem, 6 
Bolzano-Weierstrass theorem, 72 
for R fc , 86 

boundary of a set, 88 
bounded function, 133 
bounded sequence, 45 
bounded set, 21 
in R fc , 86 

in a metric space, 94 


Cantor set, 89 
Cauchy criterion 
for integrals, 274,275 
for series, 97 

for series of functions, 205 
Cauchy principal value, 333 
Cauchy sequence, 62 
in a metric space, 85 
uniformly, 202 

Cauchy’s form of the remainder of 
a Taylor series, 254 
cell in R fc , 91 
chain rule, 227 
change of variable, 295,330 
closed interval, 20,28 
closed set, 75 

in a metric space, 88,171 
closure of a set, 88,171 
coefficients of a power series, 187 
commutative laws, 14 
compact set, 90 
comparison test 
for integrals, 336 
for series, 98 
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complete metric space, 85 
completeness axiom, 23 
composition of functions, 128 
connected set, 179 
continuous function, 124,164 
piecewise, 286 
uniformly, 140,164 
convergence, interval of, 189 
convergence, radius of, 188 
convergent improper integral, 332 
convergent sequence, 35 
in a metric space, 85 
convergent series, 95 
converges absolutely, 96 
converges pointwise, 193 
converges uniformly, 194 
convex set, 182 
cover, 90 
curve, 165 

Darboux integrals, 270 
Darboux sums, 270 
Darboux-Stieljtes sums, 300 
Darboux-Stieltjes integrable 
function, 301 

Darboux-Stieltjes integrals, 301 
decimal expansions, 58,109, 114 
decreasing function, 108,235 
decreasing sequence, 56 
Dedekind cuts, 31 
definition by induction, 69 
deMorgan’s laws, 93 
dense set in a metric space, 171 
denseness of Q, 25 
density function, 335 
derivative, 223 
diameter of a fc-cell, 91 
differentiable function, 223 
Dini’s theorem, 208 
disconnected set, 178 
discontinuous function, 126 
distance between real numbers, 17 


distance function, 84 
distribution function, 334 
distributive law, 14 
divergent improper integral, 332 
divergent sequence, 35 
divergent series, 95 
diverges to +00 or — 00 , 51, 95 
divides, 9 

division algorithm, 117 
domain of a function, 123 
dominated convergence theorem, 
288 


e, 37,344 
is irrational, 117 
equivalent properties, 27 
Euclidean fc-space, 84 
Euler’s constant, 120 
exponentials, a definition, 345 
extension of a function, 146 


factor, 9 
factorial, 6 
field, 14 
ordered, 14 

F-integrable function, 301,334 
fixed point of a function, 135 
fixed point theorem, 240 
floor function, 112 
F-mesh of a partition, 320 
formal proof, 39 
function, 123 

fundamental theorem of calculus, 
292, 294 


generalized mean value theorem, 
241 

geometric series, 96 
greatest lower bound, 22 
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half-open interval, 20 
Heine-Borel theorem, 90 
helix, 166 

improper integral, 331 
converges, 332 
increasing function, 235 
increasing sequence, 56 
indeterminate forms, 241 
induction step, 3 
induction, mathematical, 2 
inductive definition, 69 
infimum of a set, 22 
infinite series, 95 
infinitely differentiable function, 
256 

infinity + 00 , — 00 , 28 
integers, 6 

integrable function, 270, 277, 291 
on M, 334 

integral tests for series, 107 
integration by parts, 293,316 
integration by substitution, 295 
interior of a set, 87,171 
intermediate value property, 
134,183 

intermediate value theorem, 134 
for derivatives, 236 
for integrals, 287,290 
interval of convergence, 189 
intervals, 20,28 
inverse function 
continuity of, 137 
derivative of, 237 
irrational numbers, 27 
7 r, 118 
e, 117 

jump of a function, 299 
A:-cell, 91 

fc-dimensional Euclidean space, 84 


L’Hospital’s rule, 242 
least upper bound, 22 
left-hand limit, 154 
Leibniz’ rule, 232 
liminf, lirnsup, 60,78 
limit of a function, 153 
limit of a sequence, 35,51 
limit theorems 
for functions, 156 
for sequences, 46,52 
for series, 104 

limits of basic examples, 48 
logarithms, a definition, 345 
long division, 110 
lower bound of a set, 21 
lower Darboux integral, 270 
lower Darboux sum, 270 
lower Darboux-Stieltjes integral, 
301 

lower Darboux-Stieltjes sum, 300 
maps, 177 

mathematical induction, 2 
maximum of a set, 20 
mean value theorem, 233 
generalized, 241 
mesh of a partition, 275 
metric, metric space, 84 
minimum of a set, 20 
monic polynomial, 10 
monotone convergence theorem, 
288 

monotone or monotonic sequence, 
56 

monotonic function, 280 
piecewise, 286 

natural domain of a function, 123 
Newton’s method, 12,259 
nondegenerate interval, 175 
normal density, 335 
normal distribution, 335 
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nowhere dense 

subset of a metric space, 171 
nowhere-differentiable continuous 
function, 348, 350,361 

open cover, 89 
open interval, 20, 29 
open set in a metric space, 87 
order properties, 14 
ordered field, 14 
oscillation function, 175 

partial sums, 95 
partition of [a, 6], 270 
parts, integration by, 293,316 
path, 165,180 
path-connected set, 180 
Peano Axioms, 2 
perfect set, 174 
7 r is irrational, 118 
piecewise continuous function, 286 
piecewise linear function, 357 
piecewise monotonic function, 286 
pointwise convergence, 193 
polynomial approximation 
theorem, 218, 220 
polynomial function, 131 
positive integers, 1 
postage-stamp function, 133 
power series, 187 
prime number, 26 
product rule for derivatives, 226 
proof, formal, 39 


quadratic convergence, 265 
quotient rule for derivatives, 226 


radius of convergence, 188 
ratio test, 99 
rational function, 131 


rational numbers, 6 
as decimals, 115 
denseness of, 25 
rational zeros theorem, 9 
real numbers, 14 
real-valued function, 123 
recursive definition, 57, 69 
remainder of Taylor series, 250 
Cauchy’s form, 254 
repeating decimals, 114 
rhomboid, 361 

Riemann integrable function, 277 
Riemann integral, 271,277 
Riemann sum, 276 
Riemann-Stieltjes integral, 321 
Riemann-Stieltjes sum, 321 
right continuous function, 310 
right-hand limit, 154 
Rolle’s theorem, 233 
root test, 99 
roots of numbers, 136 

secant method, 12,259 
selection function er, 66 
semi-open interval, 20 
sequence, 33 
series, 95 
of functions, 203 
signum function, 132 
squeeze lemma, 44,163 
step function, 289 
Stieltjes integrals, 301,321 
strictly decreasing function, 235 
strictly increasing function, 

136, 235 
subcover, 90 
subsequence, 66 
subsequential limit, 72 
substitution, integration by, 295 
successor, 1 

summation notation, 95 
supremum of a set, 22 
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Taylor series, 250 
Taylor’s theorem, 250,253 
topology, 87 

of pointwise convergence, 186 
transitive law, 14 
triangle inequality, 18, 84 
two-sided limit, 154 


unbounded intervals, 29 
uniform convergence, 184,194 
uniformly Cauchy sequence, 
184,202 

uniformly continuous function, 
140, 164 


uniformly convergent series of 
functions, 203 
upper bound of a set, 21 
upper Darboux integral, 270 
upper Darboux sum, 270 
upper Darboux-Stieltjes integral, 
301 

upper Darboux-Stieltjes sum, 300 

van der Waerden’s example, 348 

Weierstrass M- test, 205 
Weierstrass’s approximation 
theorem, 218, 220 



